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(54) Imaging apparatus comprising means for expanding the dynamic range 



(57) An object is imaged continuously during a first 
exposure time and a second exposure time shorter than 
the first eo^osure tima Weights one of which decreases 
monotonously and the other of which increases monot- 
onously are applied to first and second resultant image 
signals under the condition that the sum of the weights 
is 1. Ihe first and second inrmge signals that have been 
wdghted are added up. thus producing a synthetic pic- 
ture signal. When a luminance level is low, the ratio of 
the first image signal, which has been produced during 
the longer exposure time, to the second image signal 
increased. This results in an image demonstrating a 
high signai-toHioise ratio. When the luminance level is 
high, the ratio of the second image signal, which has 
been produced during the shorter exposure time, to the 
first image signal is increased. This results in a synthetic 
image that proves a i^de dynamic range, depicts a 
smoothly varying brightness level, and exhibits a char- 
acteristic of being seen almost natural. Moreover. Oie 



first and second image signals are produced to resem* 
ble those produced during mutually different exposure 
times bjf controlling an amount of fight incident on an 
imaging device or by varying an amount of illumination 
Hght 
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Oescrfpiion 

BACKGROUND OF THE INVENTION 

1 . Fteki of the Invent'on 

(0001] The present invention relates to an imaging 
apparatus offering a dynamic range that Is expandable 
by weighting a plurality of intage signals, which are pro- 
duced during different eoqDosure times or the lite, with a 
ptumllty of ooefftdents whose sum is 1. and adding 
them up. 

2. Description of the Related Art 

[0002] In general, a range of luminance levels within 
which imaging is validated by an imaging apparatus 
such as a TV camera is determined unconditionally with 
the photoelectric conversion characteristic of an imag- 
ing means, for example, a solid*slage imaging device. 
[0003] Specifically, a lower limit of output levels of a 
60ltd*8tate imaging device is determined by a notsa 
terel. An upper Omit thereol is determined by a satura- 
tion value. An operation range wHhin which the solid- 
state Imaging device is usable is thus defined. The 
slope of a charactefistic cun/e expressing the output 
levels of the solid-state imaging device is fixed to a cer- 
tain valua Eventually, the range of luminance levels 
within which imaging is validated by the solid-^te 
imaging device is determined unconditionally. 
[0004] For exarrple. Japanese Unexamined Patent 
Publication No. 57-33673 has disdosed an imaging 
apparatus offering a dynamic range, which is expanda- 
ble by synthesizing image signals produced at two dif- 
ferent luminarKe levels, for an image signal produced 
by a soBd-state imaging device. 
[0005] However, according to the prior art the 
dynamic range offered by the imaging apparatus is 
expanded merely by adding up two image signals or 
8i^>tracting one image signal from another. A srgnal-to- 
ndse ratio of a componerrt of a resuftant signal indicat- 
ing a low luminance level deteriorates. A synthetic lec- 
ture signal produced by synthesizing two image signal 
relative to luminance levels is plotted as joined straight 
tines or a graph of broken lines. This means that the 
synthetic image signal varies according to the graph of 
broken lines. Since an output level of a solid-state imag- 
ing device varies at a luminance level at which the 
straight lines are Joined, a constructed color Image does 
not depict a smooth color change but gives a sense of 
incongruity. 

[0006] Moreover, according to Japanese Unexamined 
Patent Publication No. 6-141229. two or more image 
signals prodiK^ed during different charge accumulation 
times are weighted based on the signal levels, and com- 
pressed by a compressing means. Thus, a picture sig- 
nal whose components ranging from a component 
representing a dark image to a component representing 



a bright image will not have a saturation value can be 
constructed with few noises. 
[0007] In the prior art. as shown in Rgs. 4 and 9 in the 
patent puts&cation, a plurality of image signals produced 

5 during differem charge accumulation times are 
weighted by varying a weight under a boundary condi- 
tion, under wtiich one of the image signals has a satura- 
tion value, or thereabout Resultant image signals are 
then synthesized by adding them up. The image signals 

10 are then compressed by a compressing means accord- 
ing to a frequency band. Eventually, a synthetic picture 
signal Ahibiting a desired input/dtitput characteristic is 
constructed. 

[0008] However, aooordng to the prior art. for exam- 
is pie, two image signals are used to construct a synthetic 
picture signal. At this time, the synthetic picture signal Is 
constructed using only a first image signal under condi- 
tions lower than the bourtdary condition under which the 
first image signal produced during a longer charge 
20 accumulation time has a saturation valua 

[0009] The synthetic picture signal is compressed on 
a subsequent stage. Since one synthetic picture signal 
resulting from addition is conpressed, the foregoing 
characteristic cannot be changed. Fbr exanrpte. when 
^ an image signal represents a motion, an image recon- 
structed may suffer from Inconsistency between con- 
toura represented by a signal component indicating a 
tow luminance level arxi a signal component indicating a 
high luminance level. Besides, the image has a portion 
so in wHch colore change unnaturally. 

SUMMARY OF THE INVENTION 

[0010] An object of the present invention is to provide 

s5 an imaging apparatus capable of offering an expanda- 
ble dynamic range without any deterioration of a signal- 
to-noise ratio of a signal component indicating a low 
luminance level, and of constructing a smooth image 
giving no sense of inoongriity. 

40 [0011] Another object of the present invention Is to 
provide an endoscopic imaging apparatus capable of 
offering an expandable dynamic range without any 
deterioration of a signal-to-noise ratio of a signal com- 
ponent indicating a low luminance leral, and of con- 

45 structing an image suitafcde for diagnosis. 

[0012] An imagirtg apparatus in accordance with the 
present invention cor^sts of: an imaging means for 
successively outputting a firat image signal, which is 
produced by imaijlng an object during a first e)qposure 

50 time, and a second image signal produced tiy imaging 
the object during a time shorter tfian the first es^osure 
time; a picture signal producing means composed of 
first and second weighting circuits for applying a first 
weight, which decreases monotonously with an 

£5 increase in light level, and a seoorxi weight which 
increases monotonously therewith, to the first and sec- 
ond image signals within the range of light levels up to 
light levels, at wHch the first and second image signals 
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have a saturation value, under the condtion that the 
sum of the first and second weights i s 1 . and an adding 
circuit for adding up first and second picture signals pro- 
duced by applying the first and second weights to the 
first and second image signals 1^ means of the first and 5 
second weighting circuits; emd a signal processing 
means for processing a picture signal output from the 
addir^ circuit to produce a video signal based on which 
an image can be displayed on a display means. 
[0013] Owing to the above components, the ratio of 10 
the first image signal to the second image signal can be 
nruxJified, and the image signals are synthesized with 
each other Consequently, the dynamic range for a pic* 
ture signal is expanded, and deterioralion of a stgnal-to- 
noise ratio of a signal component indicating a low lumi- is 
nance level is prevented. This resUts in a natural 
smooth image not giving a sense of incongruity. 
[0014] Moreover, when the present invention is 
adapted to an endoscofi^c Imaging apparatus, an image 
hetpfid for diagnosis can be provided. 20 

BRIEF DESCRIPTION OF THE DRAWINGS 

[0015] 

25 

Figs. 1 to 7 relate to the first embodiment of the 
present invention; 

Fig. 1 is a diagram showing a configuration of an 

imaging apparatus of the first embodiment; 

Fig. 2 is a diagram showing a configuration of a red 30 

dynamic range expanding circuit shown in Ftg. 1; 

Fig. 3A is a diagram showing memory maps of first 

and second lookHip tables shown in Fig. 2; 

Fig. 3 B is an explanatory diagram graphically show* 

ing weight ooeffidents output from the first and sec* S5 

end look*Mp tables in relation to an input signal; 

Figs. 4A to 41 are timing charts Moating tin^ng of 

each signal produced by the red dynamic range 

expanding circuit shown in Rg. 2; 

Fig. 5 is an explanatory diagram for explaining the 40 

operation of the red dynamic range expanding cir* 

cuit shown in Fig. 2; 

Fig. 6 is a diagram showing a configuration of a red 
dynamic range exparviing circuit of a variant: 
Fig. 7 is a diagram showing a configuration of a red 45 
dynamic range expanding circuit in the variant; 
Figs. 8A to 10 relate to the second embodiment of 
the present invention; 

Fig. 8A Is a diagram showing a configuration of a 
red dynamic range expanding circuit in the second so 
embodiment; 

Fig. 8B is a diagram showing a memory map of f irst 
and secoTKl iooknip tables shown in Fig. 8A; 
Figs. 9A to 91 are timing charts tntficattng timing of 
each signal produced by the red dynamic range 55 
expanding circuit shown in Rg. 8A; 
Fig. 10 is a graph showing a characteristic concern- 
ing brightness of an output that is a synthetic pic- 



ture signal produced according to a variant; 

Rgs. 1 1 to 17 relate to the third embodiment of the 

present invention; 

Rg. 11 is a block diagram showing a configuration 
of an imaging apparatus of the third emt)odiment; 
Rg. 12 is a block diagram showing a configuration 
of a dynamic range expancfing circuit; 
Rg. 13 is a graph indicating Input/output character- 
istics relative to a low shutter speed shutter and 
high shutter speed, and an input/butput characteris- 
tic attained by selecting a mixed function to expand 
a dynamic range: 

Rg. 14 is a diagram showing existence of a plurality 

of functions in each of looK-up tdbles; 

Rgs. ISA to 15K are timing ctauts for explain^g 

actions; 

Rg. 16 is a block diagram showing a configuration 
of a dyrtanvc range expanding circuit in a variant of 
the first embodiment; 

Rg. 17 is a graph showing a characteristic that can 
be selected to expand a dynarric range according 
to the variant 

Rgs. 18to22reiatetothefourthembodimemofthe 
present Invention: 

Rg. 18 is a block diagram showing a configuration 

of an Imaging apparatus of the fourth embodiment; 

Rg. 19 is a diagram showing a structure of a pro* 

^'essive charge-coupled device; 

Rg. 20 is a timing chart indicating output signals in 

a wide dynamic range nrKxf e; 

Rg. 21 is a timing chart Indicating an output in a 

normal mode; 

Rg. 22 is a graph indicating an input/output charac- 
teristic attained by processing outputs produced at 
a high shi^r speed shutter and tow shutter speed 
so as to expand a dynamic range; 
Rgs. 23 to 25 relate to the fifth enriiodlmem of the 
present invention; 

Rg. 23 is a diagram showing a configuration of an 
endoscopic imaging apparatus of the fifth embodi* 
ment 

Rg. 24 Is a timing chart Indicating an operation 
exerted by the endoscopic imaging apparatus; 
Rg. 25 is a characteristic graph indicating the out- 
put levels of image signals produced by first and 
secorxi charge-coupl^jl devices* and the output 
level of a synthetic picture signal produced by an 
adding circuit In relation to an amount of incident 
light: 

Rgs. 26 and 27 relate to the sixth embodiment of 
the present invention; 

Rg. 26 is a block diagram showing a configuration 
of an imaging apparatus of the sixtii embodiment; 
Rg. 27 is a timing chart indicating f ietd by field the 
relationships among an output of a charge-coupled 
device, an output of a waveform detecting circuity 
and data produced by a charge^upted device 
ehutter; 
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Figs. 28 and 29 relate to the eeventh entbodiment 
of the present int^ention: 

Fig. 2B is a block diagram Showing a configuration 
of an Imaging apparatus of tfie seventh embodi- 
ment: « 
Fig. 29 is a timing chart indicating field by field the 
relationships among an output of a charge-coupled 
device, an output of a waveform detecting circuit 
and data produced by a charge-coupled device 
shutter; io 
Figs. 30 and 31 relate to the eighth embodiment of 
the present Invention; 

Rg. 30 is a blodc diagram showing a configuration 
of an imaging apparatus of the eighth embodiment; 
Fig. 31 is a timing chart indicating field by field the 15 
relationsh^ among an output of a charge-coupled 
device, an output of a waveform detecting circuit 
and data pnxluced by a charge-coupled device 
shutter: 

Fig. 32 is a timing chart indicating an output of a ^ 
charge-ooupled device for each field in a variant of 
the eighth embocfiment; 

Figs. 33 to 40Q relate to the ninth embocSment of 
the present invention: 

Fig. 93 is a diagram schematically showing an 2S 
endoscopic Imagnig apparatus off the ninth eml)Od- 

iment; 

Fig, 34 is a diagram showing a practical configura* 

tion of an endoscopic imaging unll; 

Figs 35A and 3SB are diagrams showing a fffiter 30 

merrd!)er; 

Fig. 36 is a graph indicating characteristics attained 
when two filters are used for imaging; 
Rgs. 37A to 37C are es^anatory diagrams for 
explaining the action of a filter or the like, which is ss 
located on an opticaf path, according to a f lekf judg- 
ment signal; 

Rg. 38 is a block diagram showing a configuration 
of a video processor servfing as an image process- 
ing imit; 40 
Rg. 39 is a block cfiagram showing a configuration 
of a dynamic range exparviing unit; 
Rgs. 40A to 40Q are timing charts for explaining 
the actions of the dynamic range expanding unit; 
Figs. 41 to 52 relate to the tenth ,enrtxxliment of the 4S 
present invention; 

Fig. 41 is a diagram showing a practical configura- 
tion of a field-sequential tn>8 endoscopic Imaging 
unit off the tenth mbodiment; 
Fig. 42 is a diagram show&ig an ROB rotary filter; so 
Fig. 43 is a diagram showing a fitter member; 
Fig. 44 is a block diagram showing a configuration 
of a video processor serving as an image process- 
ing unit: 

Figs. 45A to 45F are explanatory dia^ams Indicat- 66 
Ing the actions of an endoscopic imaging unit; 
Fig. 46 Is a Iriock diagram showing a configuration 
of a dynamic range expanding unit; 



Rgs. 47A to 471 are explanatory diagrams Indicat- 
ing the actions of a signal selector Interpolator; 
Rgs. 48A and 48E are explarutory diagrams Indi- 
cating the actions of an imaging unit in the first var- 
iant; 

Rg. 49 is a dia^am showing a filter member in the 
second variant; 

Rgs. 50A to SOI are esq^tanatory diagrams Indicat- 
ing the actions of an imaging unit; 
Rgs. 51A to 511 are explanatory diagrams indicat- 
ing the actions of a signal selectDr interpolator; 
Rg. 52 is a block diagram schematically showing a 
oonliguratlon of a signal selector and interpolator; 
Rgs. 53 to 55C relate to the eleventh embodiment 
of the present invention; 

Rg. 53 Is a diagram showing part of an intaging unit 
in the eleventh embodiment; 
Rgs. 54A to S4C are explanatory diagrams indicat- 
ing the actions of the imaging unit; 
Rgs. 55A to 55C are explanatory diagrams for 
explaining the actions of an imaging unit in a variam 
of the eleventh embodiment; 
Rgs. 56 to 59 relate to the twelfth embodiment of 
the present invention; 

Rg. 56 is a diagram schematically showing a con- 
figuration of an endoscopic Imaging apparatus of 
the twelfth embodiment; 

Rgs. 57A and S7B are diagrams showing a config- 
uration of a tight source unit and a filter member; 
Rgs. 58A to 58C are explanatory diagrams indicat- 
ing the actions of a unit for controirmg an amount of 
emitted light; 

Rg. 59 is a diagram showing a configuration of a 
fight source urtit In a variant of the twelfth embodi- 
ment; 

Rgs. 60 to 61 D relate to the thirteenth embodiment 
of the present irvention; 

Rg. 60 is a diagram schematically showing a con- 
ftgurafion of an endoscopic ima^ng apparatus of 
the thirteenth embodiment; and 
Rgs. 61 A to 61 D are explanatory diagrams indicat- 
ing the actions of a unit (or controtiing an amount of 
emitted light 

OESCRIPTIOfSl OF THE PREFERRED EMBODI- 
MENTS 

I0O16] Referring to the drawings, embodiments of the 
present irtvention will be described t>elowv. 

(First Embodiment) 

[0017] As shown in Rg. 1 , an imaging apparatus 1 of 
this embodiment consists of a charge-coup! ed device 
(CCD) 2« a synchronizing (hereinafter, sync) signal gerb 
erating circuit (SSG) 3, a timir^ generator 4, and a CCD 
driver 5. The CCD 2 is a single-plate color imaging 
device for imaging an object The SSG generates a ref • 
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erence signal. The thning generator 4 inputs the refer- 
ence signal sent from the SSG 3 and produces a driving 
signal or the tike used to drive the CCD 2. The CCD 
driver drives the CCD 2 in response to the (friving signal 
sent from the tinvng generaior 4. 
[0018] The {maging apparatus 1 further Includes a 
preamplifier 6. a CDS circuit 7» and an A/D converter a 
The preamplifier 6 amplifies an Image signal s^ from 
the CCD 2. The CDS circuit 7 carries out correlative 
double sampling (CDS) according to a sampling pulse 
sent from the timing generator 4. The NO converter 8 
corwerts an analog signal output from the COS drcuft 7 
Into a digital signal. After an image signal output from 
the CCD 2 is amplified by the preamplifier 6. the fre* 
quency of the image signal is lowered to the baseband 
by the CDS circuit 7. The resultant signal is converted 
into a digital signal by the A/D converter B. The M> con- 
verter 8 converts an analog signal into a digital signal of 
8 bits long. 

[001 9] Furthermore, the imaging apparatus 1 includes 
a color separating circuit 9. a white balance circuit 10, 
an automatic gain control circuit (hereinafter, AGC cir- 
cuit) 1 1, a knee and gamma circuit 12, a red dynamic 
range expanding circuit 1SR» green dynamic range 
expanding circuit 1 50. and blue dynamic range expand- 
ing dreuit ^SG, an enhancing circuit 16, and a D/A con- 
verter 18. Specif kalty. the color separating circuit 9 
separates three color-signal components representing 
red. green, and blue from a digital signal produced by 
the A/D converter 8. The white balance circuit 10 
adjusts a white balance Indicated by each of digital sig- 
nals that are the ooior-signal cornponents separated by 
the color separating circuit 9. The AGC circuit 11 
adjusts a gain to be gh/en to each of the digital signals 
whose white balance has been adjusted by the white 
balance drcuH 10. The Knee and gamma circuit 12 
treats a knee of a curve plotted based on each of the 
digital signals whose gain has been adiusted by the 
AGC dreuit 1 1 , and corrects a gamma Indicated by the 
digital signal. The red dynamic range expancfing dreuit 
1SR, green dynamic range expanding dreuit 15G. and 
blue dynamic range expanding drcuH 158 expand 
dynamic ranges for the red, green, and Uue digital sig- 
nals that have been processed to treat a knee and cor- 
red a gamrra. The enhandng dreuit 16 enhances the 
red, green, and blue digital signals for which dynamic 
ranges ^ve been expanded by the red dynamic range 
expanding dreuit 15R. green dynamic range CKpandvig 
circuit ISO. and blue dynamto range expanding dreuit 
15B respectively. The D/A converter 18 converts the 
digital signals, which have been enhanced by the 
enhandng dreuit 16, into analog signals, and outputs 
the analog signals to a monitor 19 via a 75 O driver 17. 
[0020] The red dyriamtc range expanding dreuit 15R 
indudes. as shown in Rg. 2, a fleki memory 21, and a 
first selector 22 and second selector 23. Specifically, the 
field memory 21 stores a digital signal of a red signal 
rendering one f ieM and being processed to treat a knee 



and correct a gamrra by the knee and gamma dreuit 
12. The first selector 22 and second selector 23 select 
and output either of a red signal rendering a previous 
field and a red signal rendering a cunrent field, which are 

5 stored in the ftekl memory 21 . according to a field Judg- 
ment signal sent fmm the timing generator 4. The sec- 
ond sdector 23 is connected to the first selector 22 via 
an inverter 24. The second sdector 23 therefore out- 
puts a red signal rendering a field different from the pre- 

10 vious fieU or cunent field represented by a red signal 
output from the first selector 22. 
[0021] The red dynanvc range expancSng circuit 15R 
consists of a first look-up table (hereinafter, first Lift) 25 
and second UJT 26, a first multiplier 27, a second mul* 

15 tiplier 28« and an adder 29. Spedfically. a given function, 
which v^ll be described later, specified by the level of a 
portion of an output, that is, a red signal component of 
the second selector 23 is read from the first LUT 25 and 
second LUT 26. Herein, the red signal corrponertt 

20 rerKfers a pixel. The first multiplier 27 mult^ies the red 
signal component, which receives from the first seledor 
22 and renders a pixel, by an output of the first LUT 25. 
The second multiplier 28 muWpfies. the red signal com- 
ponent; which receives from the secord selector 23 and 

25 renders a pixel , by an output of the second LXJT 25. The 
adder 29 adds up an output of the first multiplier 27 and 
an output of the second multipner 28. and outputs a 
result to the enhandng dreuit 1 6. 
[0022] The green dynamic range expanding circuit 

30 15G and t3lue dynamic range expanding circuit 15B 
have the same circuitry as the red dynamic range 
expanding dreuit 15R. The description of fheir oonfigu* 
rations will therefore be omitted. 
[0023] The first LUT 25 and second LUT 26 are mem- 

35 ory maps like the ones shown in Rg. 3A. 

P024] In the first LUT 25 and second LUT 26, a 
weight ooefftoient f^oos^ that decreases monoto- 
nously; and a weight coeffident g><in^ that increases 
monotonously are stored at addresses 00 to FF. The 

40 addresses are each, for example. 8 bits long. The data 
of the weight coeff idertts or functions f and g is set so 
that the sum thereof will be 1 . 
[9025] ^tow. the addresses 00 to FF each having a 
length of 8 bits are associated with luminance levels 

45 indicated by a 84)it irput digital signal. More partcularly, 
assume that an image signal produced by the CCD 2 
Indicates a luminance level 0, and the image dgnal is 
converted Into a digital signal by the A/D converter 8. In 
this case; an address OOh is referenced bn the first iUT 

so 25 and second LUT 26. 

[0026] Asshown in Fig. 1. an output signal of the CCD 
2. that te, an image signal Is amplified and conrected in 
iBrrrs of a gamnxa by the AQC dreuit 11 and others. 
The signal level is adjusted according to the dynamic 

SB range permitted by the display screen of the monKor 1 9. 
[9027] in other words, when an output signal of the 
CCD 2 Indicates a luminance level 0, the level of a sig- 
nal input to the monitor 19 is also 0. When the CCD 2 is 
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saturated, the level of an image signal output to the 
monftor is adjusted to have a saturaton value (VUse in 
Fig. 5). 

[0028] Moreover, when an image signal that is an out- 
put signal of the CCD 2 has a saturation value (for 
exampla >Aise in Rg. 5). the image signal is sent to the 
A/D convefter 8 and others. An address FFh is then ref- 
erenced in the first LITT 25 and second LUT 26. Inciden- 
tally, for example, OOh means 00 in hexadecimal 
notation. 

[0029] A8tgnalxbasedonwhichtheflrstLUr25and 
second LUT 26 are referenced may be standardized to 
represent a value ranging from 0 to 1 (namely, a digital 
value OOh is associated with 0 and a digital value FFh is 
associated with 1). In this case, cos ^(px) is read from 
the fifst LUT 25 arxl sin^(px) is read from the second 
LUT 26. 

[0030] Based on a signal x based on which the first 
LUT 25 and second LUT 26 are referenced, data is read 
from an associated address. The reading is illustrated in 
Fig. 3B. 

[0031] In Fig. 3B, p denotes a correction coeffidem. 
Assume that a brightness level at which an image sig- 
nal, which is produced feiy Imaging an object during a 
short exposure lime, has a saturation value is ys2. The 
correction coefficient p Is set to a value causing the 
weight function that Is. »*n^(px) to have 1 relative to 
the brightness level of ys2. for example, p«<f (n • y62/2) . 
[0032] Next, the operations of the imaging apparatus 
1 of this errtediment having the foregoing components 
will be described. 

(0033] A driving signal is produced by the tin^ gen- 
erator 4 accoreling to a reference sigrial sent from the 
SSG 3. vm the driving signal, the CCD driver 5 drives 
the CCD 2. A photoelectrically converted signal of an 
object produced by the CCD 2 Is ampUfied by the 
preamplifier 6. The frequency ol the signal Is then low- 
ered to fan within the baseband by the CDS circuit 7. 
The resultant signal is then converted into a digital sig- 
nal k>y the A/D converter 8. 

[0034] With the driving signal.gen erated by the timing 
generator 4, the CCD driver 5 drives the CCD 2. When 
driven, the CCD 2 wilt image an object at a shutter 
speed that is different from field to field, for example, a 
first shutter speed of 1/60 sec OthenMise. the CCD 2 
will image the object using a high-speed device shutter 
at a second shutter speed that is, for example; a quad- 
ruple of the first shutter speed (that is. 1/240 sec). 
(003Sf] In other words, an object image rendering field 
A is pioduced at the first shutter speed. An otject image 
rendering field B is produced at the second sliutter 
speed. For field B. an image signal produced by expos- 
ing an object for a period of time other than 1/240 sec 
durirtg one field period (1/60 sec) is swept ew&/ quiddy 
[0036] As described later, image signals produced 
imaging an ck^ect at different shutter speeds are proc- 
essed by the red dynamic range expanding circuit 15B, 
green dynantic range expanding circuit 15Q. and blue 
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dynamic range expanding circuit 1SB. Thus, the 
dynamic ranges for red. green, and blue signals are 
ei^nded. 

[0037] Thereafter, three color-signal components of 
5 red. green, and blue are separated from a digital signal, 
which has been converted from an analog signal, tsy the 
color separating circuit 9. On the three resultant digital 
signals, white balance adjustment gain control, knee 
treatment and gamma correction are perfbrmed l^y the 
to white balance drcuH 10, AGC circuit 1 1, and knee and 
gamma circuit 12 respectively. Thereafter, the red 
dynamic range BxpanxUng circuit 15R, green dynantic 
range expanding circuit ISO, and blue dynamic mnge 
expanding circuit 158 expand the dynam'c ranges for 
IS the red. green, and blue digital signals. The enhancing 
circuit 16 enhances the digital signals. The D/A con- 
verier 1 8 converts the digital signals into analog signals. 
The analog signals are output to the monitor 19 via the 
75 n driver 17. 

20 [0038] Next, dynamic range e)q9ansion processing to 
be perfdrnned by the red dynamic range expanding cir- 
cuit 15R, green dynan^c range expanding circuit ISO, 
and blue dynamic range expanding circuit 158 will be 
detailed. Referring to the timing chart of Rgs. 4A to 41, 

2S dynante range expansion processing wi!l be described 
taking the red dynamtc range expanding drcuit 15R 
for instance. 

[0039] A field juc^ment signal (Fig. 48) is synchro- 
nous with a vertical sync signal VD (Rg. 4 A) contained 

30 in a video signal. The field judgment signal is output 
from the timing generator 4 to the second selector 23 
via the forst selector 22 and inverter 24 in the red 
dynamic range e^mnding circuit ISR. 
[0040] Moreover, a red outputof the knee and ganvna 

35 drouit 12 is applied to one input terminals of the first 
selector 22 and eeoond selector 23 in the red dynamic 
range expanding circuit 15R. An output of the field 
memory 21 (Fig. 4D) is applied to the other input termi- 
nals of the first selector 22 and second selector 23. 

40 [0041] Based on the field judgment signal, a digital 
signal produced at the first shutter speed (1/60 sec) to 
render field A is output from the first selector 22. A dig- 
ital signal produced at the second shutter speed (1/240 
sec) to render field B is output from the second selector 

45 23. 

[0042] The digital signal rendering field A and input- 
ting from the first seiedDr 22 is output Id the first multl- 
pGer 27. The dig^i signal rendering field B and 
inputting from the second selector 23 Is output to the 
so second multiplier 28. first LUT 24 (Fig. 4E). and aeoond 
LUT26{Rg.4F). 

[0043] At this time, based on a signal x that is a digital 
image signal component rendering a pixel of field B and. 
cos^(p30 and sin^(px) are output from the first LUT 25 
65 and second LUT 26. 

[0044] In tt^is case, an image signal renderirtg field A 
IS produced by imaging an object during an e)9>osure 
time (imaging time) that is fbur times longer than the 
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exposure time during which an image ^gnal rendering 
fietd B is produced. As shown In Fig. 5» the image signal 
exhibits a characteristic xloy relative to a brightness 
torel y of the object. By contrast, an image signal ren- 
dering field B exhibits a characteristic x2sy/4 . 
{0045] The image signal x1 rendering field A has a 
saturation value VUse relative to a tightness level ys1. 
The image signal x2 rendering field B has the saturation 
value Vuse relative to a brightness level y82 (s:4ys1) . 
[0046] In this embodiment, assume that an image sig- 
nal xi produced at a brightness level ya to render field 
A has. for example, a value xia in Rg. 5. In this case, an 
image signal rendering field B has a value x2a. 
[0047] As shown in Fig. 3B. the first LUT 25 and sec- 
ond LUT 28 are referenced based on the image signal 
x2 rendering field B Weight functions of fscos^(px) 
and gosin^(p)4 are then read out. 
(0048] The functions cos ^(px) and sin ^{px) are out- 
put to the first multiplier 27 and second multiplier 28. 
The first multiplier 27 multiplies a digital image signal 
component, which renders a pixel of field A, by 
cos (px) (Fig. 40). The second multiplier 28 multiplies 
a digital image sional component, which renders a pixd 
of field a by sin^(px) (Rg. 4H). 
(0049] The adder 29 adds up an output of the first mul- 
tiplier 27 and an output of the second multiplier (Rg. 41). 
[0050] In Rgs. 4A to 41, for brevity's sake, an output 
rendering each pixel of field An is denoted by An, and 
an output rendering each pixel of Held B Is denoted by 
Bn. Dynamic range expansion pfxxessing in this 
embodiment is. as mentioned atsove, carried out In units 
of a pixel. Assume that an output value that is a digftal 
image signal component rendering each pixef of field 8 
la X, and an output value that is a digital image signal 
component rendering each pixel of field B is u. An out- 
put M of the adder 29 is expressed as foKows: 

M =5 xoos'(px} iisin'(p;4 

(0051] The green dynamic range expanding circuit 
15Q and blue dynamic range expanding circuit 156 act 
similariy to the red dynamic range expanding circuit 
1 SR. The description of the nqaanding circuits will there- 
fore be omitted. 

[0052] According to this embodiment, as shown in Rg. 
5, the digital image signal x1 is produced at the first 
shutter speed (1/60 sec) to render field A. The digital 
image signal x2 (tni) is produced at the second shutter 
speed (1/240 sec) to render field B. When a luminance 
1^ is low. the output M of the red dynamic range 
expanding drcuit 15R is dominated by the digital image 
stgn^ x1 weighted with cos^(px) . When a lumlrtance 
level is high, the output M is dominated by the digital 
image signal x2 weighted with sin^(px). Thus, a 
dynan^ range can be ocpanded without any deteriora- 
tion of a signal-to-noise ratio of a picture sig^ compo- 
nent indicating a tow luminance level. 
(0053] For more details, referring to Rg. 5. the output 
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M corresponding to a synthetic picture signal produced 
by weighting two picture signals and adding them up will 
be studied When a brightness level is, for example, 
higher «ian 0 and much lower than ysl . the weight f for 

5 the picture signal rendering field A is larger. The weight 
g for the picture signal rendering field B is smaller. That 
is to say. f >g>0 Is established. The synthetic picture sig- 
nal Is a synthetic picture signal produced by slightly mix- 
ing the picture signal rendering field B in the picture 

10 signal rendering field A with pixel locations matcfied. 
[0054] Moreover, when a brightness level is higher 
than ysl. the picture signal rendering field A has a sat- 
uration value. The weight f fbr the picture signal having 
the saturation value Is smaller. By contrast, the weight g 

IS for the picture signal rendering field B is larger. Namely, 
g>f>0 is established. The synthetic picture signal is 
therefore produced by slightiy mixing the saturation 
value of the picture sigrtal rendering field A in the ^cture 
^gnal rendering field B The synthetic picture signal 

20 exhibits a characteristic of indicating a luminance level 
that increases smoothly «^ an increase In brightness 
level of an object 

(0055] In other words, according to the first embodi- 
ment, a first Image signal that has a saturation value ret- 

25 alive to a first brightness level ysl is weighted witti a 
weight coefficient f that decreases monotonously. A 
second image signal ttiat has a saturation value relative 
to a second brightness level ys2 higher than the first 
brightness level ysl (tour times higher than ysl in Rg. 

30 5) is weighted with a weight coefficient g that increases 
monotonously Resultant picture signals are added up 
by an adder. Thus, a synthetic picture signal is pro- 
duced. 

[0056] In this embodiment, the sum of the weight ooef - 
35 ficients f and g is retained at 1. It is tiius prevented that 
the level of a synthetic picture signal resulting from addi- 
tion gets larger after passing through a dynamic range 
eoqMnding circuit, and thus exceeds the level of a pic- 
ture signal to be output to the monitor 19 which is a sat- 
<o uration value, in other words, when the sum exceeds 1 . 
a compression circuit must be installed on a stage suc- 
ceeding the dynamic range expanimg drcuit. This 
embedment obviates the necessity of the oonrpression 
drcuit. 

46 [0057]. Moreover, referring to Rg. 5. the output Ma cor- 
responding to a synthetic picture signal is produced by 
weighting the image signal xia, and the Image signal 
x2a with the weight ooeffidents f and g, and adding 
them up. Herein, the Image signal xal is produced at a 

so brightness level ya in order to render field A. The Image 
signal x2a renders field B. The level of the output Ma is 
determined by adopting the levels of the signals x1 a and 
x2a according to a ratio proportional to the ratio of the 
inverse value of the weight coefftdent f. 1/f. to tfie 

66 inverse value of tfte weight coeff ident g. 1 /g. 

[0058] Moreover, as seen from Fig. 5. the output M 
may be regarded as a function of a brightness level that 
is a variable. The derived function of the function is pos- 
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Hive end decreases monotonously. That is to so/, the 
gra(£em of the derived function Is inaeased relative to 
low brightness levels. The gradient is decreased contin- 
uously wHh a rise in brightness level. This results In a 
wider dynamic range. 5 
[0QS9] A thus produced synthetic picture signal can be 
expressed as a function that increases continuously 
smoothly and monotonously by setting the coefficient p 
properly relative to the image signal x. At (his time, the 
function increases within the range of brightness levels ro 
lip to a brightness level at which a signal produced at a 
second shutter speed has a saturation valua Conse- 
quenUy, a rtatural image not giving a sense of Incongru- 
ity can be viewed. In other words, accoiding to this 
embodiment, the synthetic pcture signal M is produced is 
by weighting two whole Inriage signals (one inrutge signal 
has a saturation value) and adding them up. This 
embodiment can therefore offer a wide dynamic range 
that Is wide enough to produce a synthetic picture signal 
similar to a picture signal produced'by performing imag- 20 
ing onc%. Moreover, a picture si^ial exhibiting a charac- 
teristic of indicating a luminance level that changes 
smoothly with an increase in l)righKnes8 of an object can 
be produced to display a natural good-quality Imaga 
Moreover, even when an ob{ect makes a motion, inoon* 29 
sistency between a contour depicted by a picture signal 
component indicating a low luminance level and a con- 
tour depicted by another component indicating, a high 
luminance level Is minlntized. 

COOeO] Moreover, in this entfsodiment. two image sig- so 
nals are weighted with weight coefficients and then 
added up. The sum of the weight coefficients f and g is 
set to 1 . A picture signal resulting from addition enjoys a 
wide dynamic range ending with the signal level of an 
image signal rendering field B which is a saturation ss 
value. Moreover, it will not take place that the signal 
level Is raised before and after the Image signal passes 
through the dynamic range expanding circuit 1 5R or the 
Ilka 

10061 ] By contrast according to the prior art dtsdosed 40 
in the Japanese Unexamined Patent Publication No. 6* 
141229. a different weight is applied under a condition 
dose to a boundary conditton uider which one of two 
Inage signals has a saturation value. Image signals 
weighted are then added up. The signal level of a result- 45 
ant picture signal relative to a condition away from the 
boundary condition becomes a several multiple of the 
signal level thereof attained under the boundary condi- 
tton. A oompresston circuit for compressing a eynthelic 
picture signal must therefore be in^ied on a succeed- ffo 
ingstaga 

[0062] Moreover, the oompresslcvi circuit Is used to 
compress a synthetic picture signal so that the signal 
wiU exhibit a characteristic that the signal level varies 
continuously with an increase in brightness. In this ss 
casa the compression circuit must incur a large load. 
[0063] In this embodiment, the correction coefficient p 
is set as p%(fc • ys2/2) . Aside from tins, the correctkin 
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coefficient p may foe set to any value causing the output 
M to increase monotonously with an Increase In bright- 
ness aocoiding to the characteristics of the CCD. More- 
over, the output M Is not limited to the function 
xcos^(p)44usin'(pjO« Alternatively, the output M may 
be a fi^tction constructing a synthetic picture signal, 
which is donrtinated by an image signal produced at a 
low shutter speed, relative to a low luminance level. Rel- 
ative to a high luminance level the function constructs a 
synthetic picture signal dominated by an image signal 
produced at a high shutter speed. 
10064] In Rg. 5. fdr brevity's sake, the signals x1 and 
)2 vary linearly relative to a brightness level y. This 
embodiment can also be adapted to an imaging appara- 
tus in ¥vhich the signals vary non-finearly. 
[0065] In this embodiment, the color separating circuit 
9 sepanates red, green, and blue color signal connpo- 
nents. The red dynanvc range expanding circuit 15R. 
green (^amic range expanding circuit 15G. and blue 
dynamic range expanding circuit 15B expand the 
dynamic raises for the red. green, and blue signals. 
The present invention is not liosted to this mode. Alter- 
natively; ^e color separating circuit may separate a 
luminance signal and chrominance signal. The dynamic 
ranges for both the biminance signal and chromtance 
signal or the dynamic range for onfy the luminance sig- 
nal may be exparxied. 

[0066] In this embodiment, after color signal compo- 
nents are separated, the dynamic ranges for the signals 
are expartded. The present invention is not limited to 
this mode. Alternatively, as shown In Rg. 6. the red 
dynamic range esqpanding circuit 15R. green dynamic 
range expanding drcuit 15Q. and blue dynamic range 
expanding circuit 15B may be unused. Instead, a 
dynamic range expanding circuit 40 may be Installed on 
a stage succeeding the AJO converter 8 for converting 
an analog signal Into a digital signal. The dynamic range 
for a signal that has just been cfigitized may be 
expanded. In this case, the other components are ideT^ 
tical to those of this embodiment 
[0067] In the first emtxxfiment. the weight coeffictents 
t and g are detern^ned with an image signal rendering 
field B. AKematrvely, they may be determined with both 
Image signals rendering fields A and & In this casa the 
red dynamic range expanding circuit 15R has a oonfig- 
uraton shown in Fig. 7. 

[0068] In Fig. 2, an output ol the second selector 23 Is 
input to the first and second LUTs 25 and 26. In Rg. 7. 
an output of the first selector 22 input to the first UUT 
25, and an output of the second selector 28 is input to 
the second LUT 26. The other connections are identical 
to those shown in Fig. 2. 

[0069] In Rg. 7. a weight coefficient f is read from the 
first LUT 25 according to an image signal rerulering field 
A. A weight coeff id ent g is read from the second LUT 26 
according to an in>age s^nal rendering field 6. 
[007O] Even In this variant, the weight coeff idents f 
and g are fscos'Cpx) and gssin^(px). Herein, px is 
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defined within a range of brightness levels ys2 assod* 
ated wHh a range f^om a level 0 of the second image »g* 
nal 36 to a level of a saturation value thereof. 
[0071] In this variant, when an imaging condition 
becomes different between fields A and 6 (for example, 
a brightness level of an object becomes different 
between fiekte A and B). the sum of the weight coeffi* 
cients f and g may not be 1. Herein, the weight ooeifi- 
cient f is read based on the level of the first image signal 
x1 rendering field A. The weight coefficient g is read 
based on the level of the second image signal x2 ren- 
dering field B. In this case, therefore, f^gal is estab- 
lished. By contrast In the first embodiment the two 
weight coefficients f and g are determined based on the 
level of one image signal. ffg»1 can be satisfied. 

(Second Embodiment) 

[0072] The second errbodiment is sitetantially iden* 
tical to the first embodiment Only a difference will be 
described. The same reference numerals will be 
assigned to the same oonf^K^nents. The description of 
the components will be ontitted. 
[0073] The red dynamic range expanding drcuft 1 5R 
in this embodiment includes, as shown in Fig. 8A. the 
field memory 21, a selector 41. a first LUT 42. and a 
second LUT 44. Specifically, the field memory 21 stores 
a digital red signal rendering one field and having been 
processed to treat a knee and correct a gamma t>y the 
knee and gamma circuit 12. The selector 41 selects and 
outputs either of a red signal rendering a previous field 
and a red signal rendering a current field, which are 
stored in the field memory 21 , accofxiing to a field judg- 
ment signal sent from the timing generator 4. The field 
judgment signal is input as a high-order address bit Into 
the first UJT 42. A given function that will be described 
later is output from the first LUT 42 according to the 
level of an output signal rendering a pixel. The field 
Judgment signal is input as a high-oider address bit into 
the second LUT 44 wa an inverter 43. A given function 
that will be described later is output from the second 
LUT 44 according to the level of an output signal render- 
ing a pixel. The first multiplier 27 nrtuHipnes the red sig- 
nal output from the field memory 21 by the output signal 
rendering a pixel and an output of the first LUT 42. The 
second multiplier 28 multipHes the red sigrmi output 
from the Knee and ganvna circuit 12 by the output signal 
rendering a pixel and an output of the second LUT 52. 
The adder 29 adds up outputs of the ffrst multiplier 27 
and second muhipier 28. and outputs a resultant signal 
to the enhancing circuit 16. 

[0074] When an Image signal produced at the first 
shutter speed (1/60 sec) to render field A is output from 
the field memory 21, the selector 41 selects an image 
signal rendering field 6 which is output from the knee 
and gamma drcwX 12. The fiekf judgment signal Is input 
as a high-order address bit "0" to the first LUT 42. The 
field judgment signal is input as a high-order address bit 



"r to the second LUT 44 via the Inverter 43. 
P075] When an image signa! produced at the second 
shutter speed (1/240 sec) to render field B is output 
from the field memay 21. the selector 41 selects the 

5 image signal rendering field 6. The field judgment signal 
is Input as a ftigh-onier address bit *r to the first LUT 
42. The field judgment signal is input as a high-order 
address bit t)" to the second LUT 44 via the inverter 43. 
[0076] The green dynamic range expanding circuit 50 

10 and blue dynamic range expanding drcuit 1 SB have the 
same clradtry as the red dynamic range expanding cir- 
cuit 15R of this enrbodiment. The descr^Hion of the cir- 
adts win be omitted. 

[0077] The foregoing first LUT 42 and seoortd LUT 44 
IS are. as shown in Fig. 8B, defined in a common memory 
map. When the high-order address bit "0" Is input, 
cos ^(px) where x denotes the level of the output signal 
rendering a pixel is output When the high-order 
address bit '1* is input. 6in^(px} where x denotes the 
20 lev^ of the output signal rendering a pixel is output. 
[0078] The other components are Identical to those of 
the first ennbodiment 

10079] Next the operations of this embodiment will be 
described with reference to the timing charts of Figs. 9A 

25 to 91. 

P080] A field judgment signal (Rg. 9B) synchronous 
with a video signal VO (Fig. 9A) is output from the timing 
generator 4 to the selector 41 and first UJT 42 In the red 
dynamic range expanding circuit 15R. The fieki judg- 
$0 ment signal is also output to the second UUT 44 via tfie 
inverter 24 therein. 

[0081] A red output of the knee and gamma circuit 1 2 
is input to the field memory 21 (Rg. 9C), selector 41, 
and second multiplier 28 in the red dynamic range 
35 expanding circuit 15B. An output of the field memory 
(Rg. 90) Is input to the selector 41 and first mUtipner 
27. 

(0O82] Assume that a digital image signal rendering 
field A is stored In the field memory 21. In this case, a 

40 digital image signal rendering field B is output from the 
knee and gamma circuit 1 2 to the finst LUT 42 and sec- 
ond LUT 44 via the selector 41 In response to the field 
judgment signal. At this time, a fiigh-order address bit 
"0" is Input into the first LUT 42. cos^(px) where x 

46 denotes the level of an output rendering a pixel is output 
(Rg. 9E). A higfvorder address bit "1" is input into the 
second LUT 44. sin^(px) where x denotes the level of 
an output rendering a pUel is output (Rg. 9F). 
[0083] The fiist multipHer 27 multiptles the digital 

so image signal rendering a pixel of field A liy oo8^(px} 
(Fig. 9G). The second multiplier 28 multiplies the digital 
image signal rendering a pixel of flekl B by sin^(px) 
(Fig.9H). 

[0084] Assume that a digital image signal rendering 
55 field B is stored in the field memory 21 . In this case, the 
digital image signal rendering field B is output from the 
field memory 21 to the first LUT 42 and second LUT 44 
via the selector 44 in response to a field judgment slg- 
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naJ. At this &ne. a hl^order address bit * r is Input into 
the first LUT 42. dn (px) where x denotes the level of 
an ouljput rendering a pboel is output (F^. 9E). A high- 
order address bit of '0" is input into the second IXST 44. 
cos ^(jpx) where x denotes the level of an output render- 
ing a pixel is output (Fig, 9F). 
[0085] *nie mulbpUer 27 multiplies the digital Image 
signal rendering a pixel of field B by sin^(px} (Fig. 9G}. 
The second muttiptier 28 muHipfies the digital image sig* 
nal rendering a pixel of field A by cos ^(px) (Hg. 9H). 
[0086] The adder 29 adds up an output of the first mul- 
tiplier 27 and an output of the second multipUer 28 (Fig. 
90. 

[0087] The other components are identical to those of 
the first embodiment. 

[0088] Even In this embodiment the same advan- 
tages as those provided by the first embodiment can be 
provided. 

[00891 As mentioned above, according to th e first and 
second eirbodiments and variant* a picture signal pro- 
ducing means changes the ratio of a first image signal 
to a second image signal aocordng to a tight level inci- 
dent on an imaging means. The picture signal produc- 
ing means then synthesizes a first picture signal based 
on the first image signal with a second picture signal 
based on the second image ^gnat. The dynamic range 
for an image signal can be e^qMnded, and it can be pre- 
vented that the signal-t^noise ratio of a signal compo- 
nent indicating a low luminance level deteriorates. 
Moreover, a picture signal whose input/output charac- 
teristic changes smoothly and which renders a natural 
image not giving an sense of incongruity can be pro- 
duced. 

(0090] In the aforesaid embodiments, a first image sig- 
nal represttits a first image projected during a long 
exposure time and a second image signal represents a 
second image projected during a short exposure time. 
The first image signal and second image signal are 
weighted with two weight coefficients f and g that are 
determined relative to brightness levels ranging up to a 
brightness level at which the second image signal has a 
saturation value. The resultant image signals are added 
up. thus producing a synthetic picture signal represent- 
ing a synthetic Image. 

(0091 ] Aitematively. when a brightness level is higher 
than the brightness level at which the first image signal 
has a saturation value, a weight coefficient G specified 
with the level of the second image signal may be used 
to produce the output M having the characteristic like 
the one expressed with the curve in Rg. & 
[0092] Even in this case, the same configuration as 
the first embodiment is adopted. However, data stored 
in the first LUT 25 and second LUT 26 is different from 
that shown in Fig. 2. 

[0093] For example, as long as a brightness level 
ranges from 0 to ysl . an output Ml is identical to that in 
the first embodiment The output Ml corresponding to a 
synthetic ^cture signal is expressed as follows: 
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Ml 8 x1oos'(px) .••x2sin^(px) (0^y<ys1) 

[0094] When the brightness level y Is equal to or larger 
than ysl. an output M2 is i^rovided as follows: 

5 

M2 » x2 * Q(x2(y)) 

[0095] In this case, a boundary condition for the output 
M2 is defined as follows: 

10 

M2(ys1)aM1(ys1) 
dM1/dy»dM2Acly 

IS at y o ysl 

[0098] Namely, the derived functions of Ml and M2 
relative to the brightness level y that is ysl are equal to 
each other. 

[0097] Thus, the output M1 joins snrvK)thly with the 
20 output M2 at the brightness level ysl . Moreover, the out- 
put M2 relative to the brightness level ys2 la defined as 
Ibllows: 

M2{y82) . x2{y82) (» M(ys2)) 

(0098] The output M2 is, as shown In Fig. 10. charac- 
terized to vary snrmthly relative to brightness levels 
ranging from ysl to y82. 

[0099] In this case, from the first LUT 25. a weight 
30 coefficient cos ^ (px2) is read based on the image signal 
x2 relative to brightness levels ranging from 0 to ysl. A 
weight coefficient 0 is read relative to a brightness level 
exceeding ysl. 

[0100] Moreover, from the second LUT 26, a weight 
19 coefficient sin ^(px2) is read based on the image signal 
x2 relative to brightness levels ranging from 0 to ysl. 
When the brightness level exceeds ysl, the weight 
coefficient is set to a value satisfying the aforesaid con- 
dition. 

40 [0101] Rg. 10 graphtcaily shows a charaderist'c of an 
output M\ which is a synthetic picture signal in this case, 
relative to a brightness level y. The characteristic is fun- 
damentally identical to that shown in Fig. 5. That is to 
say, as described above, when the brightness level of 

46 an object is equal to or higher than a Isrightnese level at 
which the first image signal has a saturation value, a 
synthetic picture signal is characterized by the weight 
coefficient G specffied by the second image signal. 
[0102] In the example shown In Fig. 10. the weight 

so coefficient G deaeases monotonously relative to the 
brightness level y. The waght coefficient Q associated 
with the kxrightness level ysl is given as G(ys1)>l. The 
weight coefficient Q associated with the kxightness level 
ys2 is given as G(ys2)ai . 

66 [010Q Even in this variant almost the same advan- 
tages as those of the first ennbodimertt are provided. 
[0104] As described above with reference to. for 
exanple. Fig. 1, the dynamic range expanding circuits 
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15R. 15G. and 15B are arranged on the output stage of 
the knee and gamma drcuit 12. The dynamic range 
expanding drcuHs 15R» 15G^ and 1 SB may be designed 
to have the capabOHy of the knee and gamma drcuit 12. 
[01 05] Moreover, the dynamic range expapd\i\Q drcuit 
40 tn Rg. 6 may be designed to have the capability of an 
amplifier for ampirfying an output of the CCD 2. Herein, 
the output is emp&fted so that the saturation vaiue of the 
output level win be equal to that of a picture signal out- 
put to the monitor 19. In this case, the sum of the weight 
ooeffidents f and g may be set to a given value laiger 
than 1. The saturation value of an output level of the 
dynamic range e3q>anding circuit 40 win then be equal- 
ized to that of a picture signal output to the monita 19. 

(Third Embodiment) 

[0106] The third embodiment adopting the aforesaid 
first and second embodiments (including the variant) 
will be descrbed below. Briefly, the third en^iodiment 
indudes a brightness detecting means. A weight coefTI- 
dent characterizing a synthetic picture signal is 
selected t>ased on a signal output from the brightness 
detecdng means. Otherwise, the weight coefilcient can 
be selected manuaUy. 

[0107] The fourth embodiment adopts a progressive 
ceo havtrtg two horizontal transfer output drcuits as an 
Imaging device. 

[0108] The fifth embodinrtent is adopted to an endo- 
scopic imaging apparatus. In this embodiment, an exit 
pupil is divided into two portions. Two imaging devices 
are employed. A wide dynamic range is offered, and an 
Image suitable for endoscopic diagnosis can be con- 
structed. 

[0109] Aocorcfing to the sixth, seventh, and dghth 
embodiments, the waveform of an output signal of an 
imaging device Is detected. Based on the waveform, 
one of two diff^ent exposure times or the other thereof 
or both thereof are changed. 
[01 1 0] The ninth to thirteenth embodiments are endo- 
scopic imaging apparatuses. A filter member is located 
in front of an imaging device. An amount of light inddent 
on the imaging device is thus controDed to produce two 
Images similar to images projected during different 
exposure times. Otherwise, field-sequential color imag- 
ing m^ be earned out under fieM-sequential aiumoia* 
tion. An amount of illumination tight used to illuminate 
an ot^ect may be controlled using an iitumiinating 
means^ whereby two images similar to those projected 
during different exposure times are constructed. 
[0111] Next, the third ennbodiment of the present 
Invention will be described with reference to Figs. 1 1 to 
17. An imaging apparatus 51 shown in Fig. 1 1 irKiudes 
an imaging unit 52. a signal processing urtit 53. and a 
monitor 54. ^>ecificatty. the imaging unit 52 is responsi- 
ble for imaging. The signal processing unit S3 proc- 
esses a signal output from the imaging unit 52. The 
monitor 54 displays an image according to a vkleo sig- 



nal produced by the signal processirtg unit 53. 
[0112] The imaging unit 52 includes an Imaging lens 
55 fbr forming an ot^ject image, and a COO 56 serving 
as a solid-state imaging device located on the image 

5 piane of the imaging lens 55. The CCD 56 is a CCD 
having, (or example, a photoelectric converter and 
transfening device. A mosaic filter (or qsticaliy separat- 
ing cotor signal components Is located In front of the 
photoelectric converter. 

10 [0113] The signal processing unit 53 indudes a refer- 
ence signal generating drcidt (abbreviated to SSQ) 57 
fbr generating a reference signal. The reference signal 
generated by the SSQ 57 is output to a first timing signal 
generating drcuit 58 and a second timing signal gener- 
is ating drcuit 59. A timing signal generated by the first 
timing signal generating drcuit 58 is applied to a CCD 
driver 60. The CCD driver 60 applies a CCD driving dg- 
nal to the CCD 56 synchronously writh the timing signal. 
[0114] The CCD driver 60 outputs two CCD driving 

20 signals during one frame period (for example, 1/30 sec). 
With the CCD driving ^gnais. two image signals pro- 
duced during different exposure times are output. One 
of the two image signals produced during one frame 
period, which renders one field (however, a frame 

25 image), is produced at a high shutter speed equivalent 
to a short exposure time {for example. 1/150 sec). The 
other image signal rendering the other field is produced 
at a low shutter speed equivalent to a long exposure 
time (tor example.'four times longer than the exposure 

30 time equivalent to the high shutter speed, that is. 1 /37.5 
sec). The sum of the two exposure times is 1/30 sec 
corresponding to one ordinary frame period during 
which a standard video signal is scanned. 
(01 15] The image signal (charge) produced at the high 

3S shutter speed and the image signal (charge) produced 
at the low shutter speed are read altemately from the 
ceo synchronously with a vertical sync signal (abbrevi- 
- ated to VD) during one field period. 
[01 16] An image signal is photoef ectrically corrverted 

40 by the CCD 56. and then output from the (transferring 
device) CCD 56 to a preamplifier 61 . After amplified, the 
image signal is input to a correlative doutsle sampling 
(CDS) drcuit 62. A reset noise and others are removed 
arvf ^gnal components are extracted. The resultant sig- 

45 nal is input to an A/D converting drcuit 63 and bright- 
ness sensing circuit 64. 

[01 17] The A/D converting drcuit 63 converts an ana- 
log dgnal into a digital signal. The digital signal is input 
to a dynamic range expanding drcuH (D range expand- 
so ing drcuit in Rg. 1 1) for eiqianding a dynamk: range. A 
selection signal output from the brightriess senskig cir- 
cuit 64 is also input to the dynamic range expanding cir- 
cuit 65. 

[0118] The brightness sensing drcut 64 detects a 
66 maximum luminance level indicated by the image signal 
produoed at the high shutter speed. Based on the max- 
imum lunrdnance level, the brightness sensing drcuit 64 
produces a selection dgnal assisting in selecting a func- 
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flon used to expand a dynamic range by the dynamic 
range expanding droA 65. 

[0119] For example, depending on whether the maxi- 
mum luminance level exceeds a reference value, a 
selection signal indicating either of dynamic range 8 
expansion modes is output In one of the modes, the 
dynamic range for an image signal is eo^anded so that 
the image sIgnaJ wi8 exhSsit a characteristic that even a 
signal component indicating a high luminance level 
does not have a saturation value. In the other mode« the to 
dynamic range for an image signal is expanded so that 
the nrage signal exhibfts a characteristic that a signal 
coinponent indicating a leaver luminance level does not 
have the saturation value. 

[0120] The brightness sensfng circuit 64 is composed is 
of a peak value detec&^ circuit 64A fSor detectkig a 
peak value and a comparing drcurt 64a The maximum 
luminance level can therefore be detected by the peak 
value detecting drcuit 64A. An output of the peak value 
detecting droBt 64A is compared with a reference value so 
Vref by the conparlng drcuit 64B. An output signal of 
the comparing circuit 648 is input as the selection signal 
to the dynamic range expanding ciroit 65. 
(0121] A signal, fbr wMch dynairdc range has been 
expanded by the dynantic range ei^sanding circuit 65 is ss 
irput to a processing drcuit 66. Color sigrmi oanpiy 
nents are then separated and converted into redrgreen» 
and blue signals. The white balance detected in each of 
the red, green, and blue signals is adjusted. The result- 
ant signals are then input to a contour enhancing drcuit so 
67. 

(0122J The contour enhandng circuit 67 enhances the 
red. green, and kalue eignaJs in terms of the contour of 
an image. The resultant red, green, and blue signals are 
input to and stored temporally In a memory 68. Signals 
read from the memory 68 are input to a 0/A converting 
drcuit 69. and then converted into analog red, green, 
and blue signals. The red. green, and blue signals.are 
input to a monitor 54. An object image is displayed In 
colors on a monitor screen. 40 
[01 23] An output signal of the second timing generat- 
ing drcuit 59 is input to the dynamic range expanding 
drcuit 85, processing drcuit 66, contour enhandng dr- 
cuit 67. and memory 68. 

[0124] Rg. 12 shows a configuration of the dynamic 45 
range entiancmg circuit 65. A digital image signal sent 
from the A/D converting circuit 64 is temporanly stored 
in a memory 71 taving a storage capacity oonespond* 
big to the number of aO pixels permitted by the CCD 56. 
The image d^ial is then input to a fiiat look-up tdble 60 
(UJTi 73A and second LUT 738 via selectors 72A and 
728 which are switched according to a field Judgment 
signal sent from the second tinvng signal generating dr- 
CUH59. 

[01 25] Moreover, a signal read from the memory 71 Is ss 
input to the first LUT 73A and second LUT 738 via the 
selectors 72A and 728. A selection signal produced by 
sensing a brightness level by the brightness sensing dr- 



cuit 65 Is Input to the first LUT 73A and second LUT 
738. 8ased on the selection signal a synthesis function 
actually employed is selected from among a plurality of 
synthesis fOncttons that are stored In the first LUT 73A 
and second LUT 738 and used to expand a dynamic 
ranga 

[0126] Signals read from the first LUT 73A and second 
LUT 738 are input to an adding circuit 74, and then to 
an interpolating circuit 75. After interpolated, a resultant 
signal is provkfed as an output signal of the dynamic 
range expandii^ drouft 65, and Input to the processing 
tiroM 66 on the succeeding stage. Color signal compo- 
nents are then separated. 

10127] Rg. 13 is a graph showing cun/es expressing 
different input/output characteristics represented by 
synthesis functksns one of wt^lch is sheeted with a 
selection signal output from the ({Tightness sensing cir- 
cuit 64 in order to es^and a dynamic r»tge. 
(01281 When an otject Is toge at a low shutter 
speed, an output of the CCD exhibits a characteristic Si 
of inoreaslng along a straight line, which has a large 
dope, relative to an anfiount of incident light. Once the 
output has a level of a saturation value Csat the output 
remains constant By contrast when the object Is 
fanaged at a high shutter speed, the CCD output exhibits 
a characteristic Ss of increasing along a straight One. 
whteh has a small slope, relative to an amount of ind* 
dent light 

[01 29] image data items produced to exh3)H the char- 
adeHstics SI and Ss are weigfrted through the first LUT 
73A and seoorvl LUT 738, wheretsy a dynamic range 
can be expanded. In this enrtedimertt. a sefectton sig- 
nal is used to select a function used to expand a 
dynamic range. 1Wo characteristic fOnctkvis SI and Ss 
are synthesized by assigning them to the selected func- 
tion. Consequentiy, the dynamic rartge for a signal can 
be expanded so that tiie sifpud will exhitilt either of 
input^oulput characteristics A and B drawn wHh a dot- 
dash line and alternate kmg and two short dashes One 
respectivBly. 

01130] For example, when a maximum luminance 
level detected in a dgnal is high, the dynamic range for 
the signal is expanded so that the signal win exhibit 
diaracteristic 8. Specifically, a signal component indi- 
cating a tow luminance levd will be suppressed. A sig< 
nal componertt indicating a high luminance level wilt not 
have a saturation value, and a variation of the signal 
component will be reflected in an Image displayed. 
When tfie maximum tuminance ImI detected In a sig- 
nal is low. the dynantic range for the dgnal Is expanded 
so that the signal w&l exhibit characteristic A. Spedfi- 
cally, a dgnal oonponent Indicating a high luminance 
level will t)e suppressed, and a variation of a signal com- 
ponent indicate a low luminance level wSI be reflected 
in an image di^layed. 

[01 31] In this embocfiment, the first LUT 73 A and sec- 
ond LUT 738 store a plurality of synthesis functions 
used to expand a dynamic ranga Rg. 14 shows data of 
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the functions stored in the first LUT 73A and seocHftd 
LOT 73B respectively. 

[0132] 1he first LUT 73A and second LUT 73B have 
addresses each having a length of. for example. 9 bits. 
Functions FO and QO are allocated to lower 8^it s 
addresses 000 to OFF. and functions F1 and Q1 are 
afiocated to upper 8-bH wtdresses 100 to 1 FF 
C0133] A signal passed by the A/D converting circuit 
63 or a signal read from the memory 71 is applied to the 
lower 8-bit address terminals^ A selection signal sent io 
from the brightness sensing circuit 64 is applied to the 
uppermost address terminal. Based on the selection 
sl^rial. any of a plurality of functions used to a)qpand a 
dynamic range is selected 

(0134] For exanrple. when the selecfion signal is low is 
or 0, data of the furtction FO or GO is read out. In this 
case, a resultant signal exhbits the characteristic A 
shown in Rg. 3. When the selection signal is high or 1, 
data of the function F1 or G1 is read out In tfiis case» 
the resultant signal exhibits the characteristic B shown za 
In Fig. 13. 

(0135] Next the actiors of INs entediment wiU be 
described with reference to the timing charts of Figs. 
ISA to 15IC 

(0136] As Shown in Fig, ISA. the CCD driver 60 25 
applies signal readout pulses RSI and RLI shown in Fig. 
1 SB to the CCD 56 at the starts of a short exposure time 
SI and long exposure time LI (l»1. 2, etc.). Charge of a 
signal photoelectricaQy converted by the photoelectric 
converter of the CCD 56 and then stored transfen'ed 3o 
to the transfer device of the CCD 56. 
[0137] When the signal charge transferred to the 
transfer device has been produced during the short 
exposure time SI, the read transterred signal is applied 
synchronously with a vertical sync signal VO shown in 9S 
Rg. 15D during one field period The signal is stored as 
a CCD output CSI shown in Rg. 15C in the memory 71 
as shown in Rg. 15F. and applied to the second LUT 
7dA via the selector 72 A 

(0138] When the signal charge transferred to the 40 
transfer device has been produced during the long 
exposure time Li. the read transferred signal is applied 
synchronously with the vertical sync signal VD immedi* 
at^ succeeding the signal read pulse RLI during one 
field period. The signal is stored as a CCD output CLl 48 
shown in Rg. 15C in the memory 71 as shown In Rg. 
1 5F, and applied to the second LUT 73B via the selector 
73B. 

(0139] The selectors 72A and 726 are swH^ed with a 
field judgment signal, which is shown in Rg. 16E, oulput so 
from the second timing signal generating drcuit 59. For 
example, when the field judgment signal is high, a node 
a shown in Rg. 12 is selected. The CCD output CSI is 
input to the first LUT 73A A signal produced during the 
previous frame period and stored In the memory 71 . that ss 
is, a CCD output CLI-1 Is input to the second LUT 73B. 
(0140] Moreover, when the field Judgment signal is 
low, a node b is selected. The CCD output CSI read 



from the memory 71 Is input to the first LUT 73A, and 
the CCD oulput CLl is Input to the second LUT 73a 
(0141] For brevit/s sake, outputs of the selectom 72A 
and 72B are i totrated to be input to the ftr^ LUT 73A 
and second LUT 73B respectively as indicated with 
solid lines. Aiternatively. they may be Input to fhB first 
LUT 73 A and second LOT 73B as indicated with dashed 
lines in Rg. 12. 

(0142] In this case, the functions FO and QO are FO(SI. 
U) and QO(SL LQi titus stressing the characteristics of 
image signals produced during the short exposure tbne 
SI and long ai^osure time U. 
(0143] When two signals are input to each of the first 
LUT 73A and second LUT 73B. syrrthesis can be 
achieved more finely. 

(0144) For inputting two Signals, since the number of 
bits is very large, some high-order bits of the signals 
may be input In this case, a ROM whose storage 
capacity is not very large may be used as the first LUT 
73 and secorxt LXJT 73& 

(0145] For eseample, when the selection signai is. as 
shown in Rg. 15K. low. the lUncfionFO is selected from 
the first LUT 73A as shewn In Rg. 15H. Moreover, the 
function GO is selected firom the second LUT 73B as 
shown in Rg. 151. In this case, the functions are added 
up by the addirtg circuit 74. An additive output Hshown 
in Fig. 15J. that is, a n^ed (unction H is therefore 
FO^GO. The dynamic range for a signal is expanded so 
that the ^gnal wiH exhbit the characteristic A shown in 
Rg. 13. 

[0146] When the selection signal is high, the function 
Fl in the first LUT 73A is selected for use The function 
Q1 in the second LLfT 73B is selected lior use. In this 
case, the functions are added up by the adding circuit 
74. The mixed function H becomes FI4QI. Ihe 
dynamic tange for a signal is expanded so that tite sig- 
nal will exhibit the chamcteristic B shown in Fig. 13/ 
[0147] As mentioned above, when the maximum 
brightness level of an object is high, or In other words, 
when the maximum luminance level detected in an 
image signal is high, the dynamic range for an innage 
signal is expanded so fhaX the signal wDl be cfiaracter- 
ized by a signal component indicating a high luminance 
level. Specifically, the signal component indlcatirrg a 
high luminance level reflects a change in brightness of 
the object. When the maximum luminance level is low. 
the dynan^ range Ibr a signal is exparuled so that ttie 
signal will be characterized tiy a signal conponent ircli* 
eating a low luminance level Specifically, the signal 
component incScating a low luminance level reflects a 
cfiange In brightness of the object 
[0148] According to this embodiment, ttte dynamic 
range for a signal can be expanded so that the signal 
wifl exhbit a characteristic sizable fOr an actual use 
environment (or Imaging environmenQ. 
[0149] Fig. 16 shows a configuration of a dynamic 
range eocpanding drcuit 65* In a varlam of the third 
embodiment 
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[01 50] Aocofding to this variant, a select'on signai and 
selection instruction signal are Input to the first LUT 73 A 
and second LUT 73B, which are Included In the 
dynamic range expanding drcuit 65 shown in Fig. 12, 
via a selector 78. Herein, the selection signai is sent 
from the brightness sensing ctrcurt 64 and ^e selection 
Instruction signal Is sent from a selection switch 77 han- 
dled manually tiy a user. 

[0151] The selector 78 can be handled manually. The 
selector 78 may be set to a state in wNch the selection 
signal sent f^om the brightness sensing circint 64 is 
selected. Altemativeiy. the selector 78 may be set to a 
slate in wttich the setecHon Instruction signal sent from 
the selection switch 77 that can be handled by a user is 
sheeted. 

[0152] in this variant, a firet LUT 73A* and second LUT 
736' contain numerous functions FO, F1, F2. etc. and 
GO. Q1, Q2. etc. An actually used (unction is selected 
from among the numerous fiinct'ons FO. F1. F2. etc.. 
and GO. Q1.Q2.etc. 

(015SQ By selecting any of the functions, the dynamic 
range for a signal can be expanded so that the signai 
will exhibit any of the different characteristics A. C« 
and D shown In Rg. 17. 

[0154] In this variant three or more functions (or three 
or more sets of functions) can be selected. The selec- 
tion signal is therefore a digital signai of two or more bits 
long. In tfiis case, the brightness sensing circuit 64 
detects a maximum luminance level and minimum lumi- 
nance level in an image signai produced at a high shut- 
ter speed. The selection signal to be produced indicates 
whether the maximum iumirtance level and ntinimum 
luminance level are equal to or higher than reference 
values. 

[015$) A function is selected as descrbed beiow. For 
exampie^ when the maximum luminance level is high, 
the dynamic range iar a signal will be expanded by 
putting emphasis on a signal component indicating a 
Ngh lumiruince level. When the maximum luminance 
level ' Is low. ttie dynamic range for a signal will be 
expanded by putting emphasis on a signal conponent 
indicating a low luminance level. When the minimum 
luminance level is high, the signai component indicating 
a low luminance level wiil be suppressed. On the con- 
trary, when the minimum luminance level is low. the 
dynanrvc range for a signal will be expanded so that a 
signal component indicating a low luminar«ce level will 
not t>e suppressed. 

[0156] To be more specific, assume tiiat the maxlrvuim 
luminance level detected in a signal is high and the min* 
imum luminance level detected thera*n is low. in this 
case, the dynamic range for the signal is expanded by 
putting emphasis on signal components indicating l^gh 
and low lunvnance levels. In other words, the dynamic 
range for the signal is expanded so that the signal will 
exhibit the characteristic D shown m Rg. 17. Mamely. a 
signal conponent indicting an Intermediate luminance 
level wai be suppressed and the signal components 



indicating high and low luminance levels vm'II be enpha- 
sized. 

[0157] Moreover, assume ttiat the maximum fumt- 
nanoe level detected in a signal is low and the minimum 

5 luminartce level detected therein is tow. In this case, the 
dynamic range for the signal Is expanded so that a sig- 
nal component indicating a Ngh lun^nance level will be 
suppressed and a signal conponem indicating a tow 
luminance level will be emphasized. In other words, the 

10 dynamic range for the signal is expanded so that the 
signal win exhibit the characteristic A shown in Fig. 17, 
Namely, the signal conponent indicating a high lumi- 
nance level win be suppressed and the signal compo- 
nent indicatir^ a low luminance level w9l be 

15 enpf>asized. 

(01 58] The other components are identical to those of 
the first embodiment According to this variant the 
dynamic range for e signal can be expanded using a 
rrdxed function suitatsle for a brightness level of an 

20 object sensed by the brightness sensing circuit 64. 
[0159] Moreover, a user can expand the dynanr^ 
range for a signal so that the signai will exhibit a charac- 
teristic different from a characteristic selected by sens- 
ing a brightness level. That Is to say. a signal component 

25 flKtracted from a cfifferent viewpobit will be able to be 
errphasized. 

[0160] For example, assume that a change in lurrti- 
nance in a normal image nuist be okiserved t>y putting 
emphasis on. especiatty a dark portion. In this case, the 

30 characteristic function C shown in Rg. 1 7 is selected. 
Consequently, ttie dynanrtic range for a signal is 
expanded so that a change in luminance indicated tiy a 
signal component indBcating a low luminance level will 
be reflected and a signal conponent Indicating a high 

55 luminance level will be suppressed. 

(Fourth Embodiment 

[0161J Next the fourth embodiment of the present 
40 invention will be described with reference to Rgs. 18 to 
22. 

[0162] An imaging apparatus 80 shown in Rg. 18 con- 
sists of a camera head 81, a camera control unit (here- 
inafter, ecu) 82. and a TV monitor 83. Specifically, the 

43 ecu 82 controls the camera head 81 and processes an 
output of the camera head. The TV nrwnitor 83 is an 
Interlacing type display for displaying an image whose 
data has been processed by the CCU 82. The camera 
head81 is mounted on an eyepiece unit of, fbr example. 

so a rigid endoscope. 

10163] The camera head 81 includes a COO 85 that is 
a progressive scanning type Imaging device (hereinaf- 
ter, progressive CCD). The progressive CCD 85 photo- 
electrically converts an object image formed on the 

55 image plane of an Image formation lens that is not 
shown, and outputting an analog Image signal. The pro- 
gressive CCD 85 has two output systems: tfiat is. a first 
oulput system for providing a first CCD ou^ 85a and 
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a second output system for pro>ddtng a second CCD 
output 85b. 

[0164] An output of the camera head 81. that is. the 
first CCD output 85a and second CCD oidput 85b are 
routed to the CCU 82 over signal cables that are not s 
shown. 

[0165] The CCU 82 includes CDS/AQC circuits 86a 
and 86b. A/D converting circuits 87a and 87b. LUTs 88a 
and 88b, an adder 89. a swilcNng means 90. a dgitaJ 
signal processing (DSP) circuit 91 . a 0/A converting dr* io 
cult 92. a timing generator (TG) 93. and a syne signal 
generating circuit (SSG) 94. Specifically, the CDS/AQC 
circuits 868 and 86b amplify the first CCD output 85a 
and second CCD output 85 (control gains autono- 
mously), and carry out correlative double sampling and is 
others. The A/D converting circuits 87a and 87b convert 
outputs of the CDS/AQC circuits 86a and 86b Into digital 
signals. The LUT 88a and 88b are referenced in order to 
convert data rranlinearty according to the outputs of the 
A/D converting drcurts 87a and STb, and output result- so 
ant data. The adder 89 adds up outputs of the LUTs 88a 
and 88b. The switching means 90 selects an ou^ of 
the adder 89 in a wide dynamic range mode. In a normal 
mode, tie »vltchlng means 90 selects an output of the 
A/D converting circuit 87a. The DSP circuit 91 digitally 25 
processes an output of the switching means 90. The 
D/A converting circuit 92 converts a digitized signal into 
an analog signal. The TQ 93 supplies a driving pulsat- 
ing signal to the progressive CCD 85 and CDS/AGC cir< 
cults 86a and 86b. The SSQ 94 supplies a reference so 
signal to the TG 93. A/D converting circuits 87a and 
87b. and DSP 9t 

[0166] The LUTs 88a and 88b and the adder 89 con- 
stitute a dynamic range expamSinQ means. 
[0167] An output of the D/A converting circuit 92 is 35 
output to the TV monitor 83 connected over a signal 
cable that is not showa An operator handles the rigid 
endoscope in various manners wNle viewing the TV 
monitor 83. 

[0168] Naxt. a configuration of the progressive CCD ^o 
85 win be desaibed with reference to Fig. 19. For brev- 
ity's sake, only a small number of pixels are shown in 
Rg. 19. In reality, the progressive CCD includes a larger 
number of pixel locations. 

[0169] The progressive CCD 65 consists of a plurality 4S 
of photodiodes 96. vertical shift registers 97, and two 
systems of horizontal shift registers 98a and 98b. Spe- 
ctficaOy. the plurality of fjhotodiodes 96 is arranged two^ 
dimenslonaily. The vertical shift registers 97 transfer 
charges accumulated in the photododes 96 in a vertical so 
direction. The two systems of liorizontal shift registers 
98a and 98b transfer charges, which are sent from the 
vertical shift registers 97. in a horizontal direction. Out* 
puts of the horizontal shift regist^ s 98a and 98b are the 
first CCD output $5a and second CCD output 8^ ss 
[0170] Readout by the progressive CCD 85 will be 
described with reference to Rgs. 19. 20. and 21 . 
10171) To begin with, readout in a wide dynamic range 



mode will be described. 

ID172] Charge Is accumulated in the photocfiodes 96. 
At this fime. control is given so that a charge accumuf a- 
tion time wiO be different between odd lines 0DD1. 
0DD2. 0DD3, etc. and even Ones EVENI. B/EN2. etc. 
in other words, for example, a high shutter speed of 
1/240 sec is set as the charge accumulation time for the 
odd (ines. A low shutter speed of 1/50 sec (^4/240 sec) 
is set as ths charge acaaimlation time for the even 
Ones. Charge is swept away ftrom the odd lines dwbig 
3/240 sec within the charge accumulation time 1/60 sec 
within which charge is accumulated on the even lines. 
Ctege is accumulated on the odd lines during the 
rernaining 1/240 sec. 

(01 73] The charges thus accumulated in the photodi- 
odes 96 are trar^ferred all together to the vertical shift 
registers 97. Thereafter, the vertical shift registars 97 
shift charges constituting two lines in the vertical direc* 
tloa Consequently, the charges on the even line EVEN1 
are transferred to the horizontal shift register 9eb. The 
charges on the odd line GDDI are transfened to the 
second horizontal shift register 98b. TKs causes the 
horizontal shift registers 98a and 98b to quickly shift 
data items constituting one fine in the horizontal direc- 
tion. 

. 10174] Thereafter, the vertical shift registers 97 shift 
charges constituting two lines in the vertical direction. 
The charges on the even fine EVEN2 are then trans- 
ferred to the ftfst horizontal shHt register 98a. The 
charges on the odd line 0DD2 are transferred to the 
second horizontal shift register 98b. Similarly, the hori- 
zontal shift registers 98a and 98b shift charges in the 
horizontal direction. These operations are repeated. 
[0175] When the charges In all the photodiodes 96 
have been transferred, charge transfer for one field is 
completed. For this field, the first horizontal shift register 
98a outputs an ^age signal produced at the low shutter 
speed to represent the even lines. The second horizon* 
tal shift register 98b outputs an Image signal produced 
at the high shutter speed to represent the odd line& 
Whether the field is regarded as an even field or odd 
field can be determined appropriately. Since the output 
of the first shift register 98a represents the even lines, 
the field shall be regarded as an even field. 
[0176] Thereafter, for reading data that renders an 
odd field, a combination of lines from which charges are 
transferred to the horizontal shift reglstere 98a and 98b 
Is changed. 

IP177] First. Charge Is accumulated during a time that 
is different tMtween the odd lines and even tines. At this 
t'me^ the shutter speeds at which the odd Snes and even 
lines are formed are opposite to those for rendering the 
even field. For example, the odd tines are formed at the 
low shutter speed of 1/60 sec and the even lines are 
formed at the high shutter speed of 1/240 sec. 
[0178] Charges thus accumulated in the photodiodes 
96 are transfenred simultaneously to the vertical shift 
registers 97. Thereafter, the vertical shift registers 97 
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shift charges constituting one line in the vertical direc- 
tion. Charges constituting the odd One 0001 are then 
transfmd to the first horizontal sNft register 98a. The 
first horizontal shift register 98a shifts the charges in the 
horizontal direction quickly. 

[0179] Thereafter, the vertical shift registers 97 trans- 
fer charges constituting two lines in the vertical direc- 
tion. Charges ooristitutlng the odd line ODD2 are 
therefore transferred to the f orst horizontal shift register 
98a. Charges constituting the even line EVEN1 are 
transterrad to the second horizontal shHI register 98tx 
The horizontal shift registers 98a and 98b each iiuicMy 
transit data items constituting one line In the horizontal 
direction. ITiereafter. the vertical sHft registers 97 trans- 
fer charges constituting two lines successively. The hor- 
izontal shift registers 98a and 98b output the charges In 
due couisa 

[0180] When ttie charges in all the photodiodes 96 
have been transferred, transfer of charges for rendering 
the odd field is completed. For the odd field, an image 
signal produced at the low shutter speed to represent 
the odd lines is output from the first horizontal shift reg- 
ister 98a. An Image signal produced at the high shutter 
speed to represent the even l&iea is output fifom the see* 
ond horizontal shift register 98b. 
(0181] The output of the first horizontal shift register 
9da that is an image signal produced at the low shutter 
speed the first CCD output 85a. The output of the sec- 
ond horizontal shift register 98b that is an image signal 
produced at ttie high shutter opeed is the second CCO 
output 85b. 

(0182] As shown in Rg. 20, during an odd field period 
within one frame period of 1^0 sec, the data represent- 
ing tiie odd lines (ODD) is output as the first CCO output 
8Sa. The data representing the even lines (EVEf^ is 
also output as the second CCD ou^ 8Sb. During a 
subsequent even field period, the data r^resentlng the 
even lines (EVEN) is output as the ftrst CCO output SSa. 
and ttie data representing the odd lines (ODD) is output 
as the second CCO output 85b. Large dynamic range 
processing to be performed based on the data items will 
be d6scrft>ed later. 

(0183) Next, readout in the normal mode will be 
described. 

(0184] in the normal mode, the charge accumulation 
time during which charge is accumulated in the photodi- 
odes 96 la the same between the even Ones and odd 
lines. 

[018S] Charges thus accumulated are transferred 
simultaneously from the photodiodes 98 to the vertical 
shift registers 97. Thereafter, the vertical shift registers 
97 shtfl charges constituting one line in ttie vertical 
directioa (Charges constituting the odd 6ne 0DD1 are 
theretbre transferred to the f ti^t horizontal shift register 
98a. Thereafter, the vertical shift registers 97 shift 
charges constituting one One in the vertical direction. At 
this time, ttie potential at the second horizontal shift reg- 
ister 98b is. for examples high to prevent the charges 



from being tiansferred to the second horizontal shift 
register 98b. The data representing the odd fine C0D1 
and the data representing the even line EVEN1 are 
added up in the first horizontal shift register 98a. The 

5 horizontal shift register 98a then quicMy sttifts the 
resultant data in the horizontal direction. 
(0188] Ukewise. the vertical shift registers 97 shift 
charges constituting two lines In the vertical direction. 
The data representing the odd line 0DD2 and the data 

10 representing the even line E\/EN2 are added up in the 
horizontal shift register 98a The sintiiar operations are 
then repeated. 

(0187] Fbr reading data that renders a subsequent 
field, a combination of lines whose data items are to be 

15 added up is changed. 

(0188] Specifically, as mentioned above, charge is 
accumulated during a time ttiat ts the same between ttie 
odd lines and even Rnes. Charges accumulated in ttie 
photodiodes 96 are then transferred simultaneously to 

20 ttie vertical shift registers 97. Thereafter, the v^tical 
shift registers 97 transfer charges constituting one fine 
(data of tiie odd line 0DD1) in the vertical direction. The 
first horizontal shift register 98a quickly shifts ti)e 
charges In the horizontal direction. 

2S 19189] Thereafter, the vertical shift registers 97 shift 
charges constituting two lines in the vertical direction. 
The data of ttie even fine EVEN 1 and ttie data of the odd 
line 0DD2 are added up tn ttie horizontal shift register 
98a. The horizontal shift regteter 98a then shifts ttie 

90 resultant data in the horizontal direction and ttms out- 
puts it. The addition and output will be carried out in ttie 
same manner thereafter. 

(0190] As mentioned above, the foregoing data items 
rendering two fields are. as shown in Fig. 21. output 
35 successively, as odd4ield (ODD) data and everhfield 
(EVEN) data from the first CCO ou^ut unit 85a. 
(0191] Now, how frnage data out|Mit from the progres- 
sive CCO is processed by the CCU 82 will be described 
below, 

40 (01 92] To begin witti. processing in the wide dynamic 
range mode wii) be descr3)ed. In this mode, the switch* 
\ng means 90 is changed over to the adder 69. 
(0193] The first CCD output eSa and second CCD out* 
put 85b are amplified by ttie CDS/AGC cbcuits 86a and 

45 d6b respectively. Correlative double sampling and otht 
ers are carried out Outputs of the CDS/AQC circuits 
86a and 86b are converted Into digital signals by the 
A/D converting ciroAts 87a and 87kx The outputs are 
ttien converted by referencing the LUTa 88a and 6Bb. 

60 The converted oirtputs are ttien added up by ttie adder 
' 89 on the succeeding stage, and th&i converted Into 
given data items as outputs having undergone v^de 
dynamic range processing. 

(0194] The wide dynamic range processing will be 
55 described witti reference to Fig. 22. 

(01 95] Fig. 22 shows retationshtps t>etween the bright- 
ness level of an object and the levels of Image signals 
produced at different shutter speeds (charge accumula* 
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tion times). 

[0196] When an object is imaged at a low shutter 
speed (LS). it means that a charge accumulation time is 
long. A dark portion of the object can be imaged more 
accurately. However, a portion of the object whose s 
brightness level Is so high as to exceed Bs In Rg. 22 
cannot be imaged property. This is iDecause a corre- 
sponding signal oornponent output from en Imaging 
device has a saturation value as a level Vs. 
(0197] On the other hand, when an object is imaged io 
at a high shutter speed (HS), an amount of light accu- 
mulated In the photodiodes 96 inihe progressive CCD 
65 (8 reduced. The CCD output is therefore plotted as a 
straight line HS. which is incfined smoothly, in Rg. 22. 
Even when an object whose brightness level exceeds is 
Bs Is imaged, a produced Image signal wfH not have the 
saturation value. 

[0198] Thus, when an object is imaged at a low shutter 
speed, a porton of the object whose brightness level 
may be so high that the CCD Is saturated. In this case, so 
the oorresponcfing portion of the object image is com- 
pensated using an image produced at a high shutter 
speed. TNs results in an image in which a daric portion 
of the object is not seen blackened and the higfvbilght* 
ness level portion is not seen streakily whitened. In 25 
other woids, a picture signal (whose data is plotted aa a 
curve HD in Rg. 22) proving a wide dynamic range can 
be produced. 

[0199] Assume that the data of the first CCD output 
65a produced at ttte low shutter speed is x and the data so 
of the second CCD output 8Sb produced at the high 
shutter spaed is y. Data processed to expand a dynamic 
range, z. is expressed by the fdltowing equation 1 : 

where functions f and g are defined in considera- 
tion of the output characteristic of the progressive CCD 
65. 

[0200] The dynamic range expansion processing is 4o 
generaOy nonlinear processing. If an arithmetic opera- 
tion were carried out at every inmging. the load of the 
arithmetic operation would Increase and the processing 
time would extend 

[0201] Data to be Involved in the arithmetic operation . 48 
of the akx>ve equation is therefore stored in advance in 
tables, that Is, the LUTs 88a and 88b. In practioe, the 
LUT s are referenced to draw out a result 
[0202] Odd (even) One data and even (odd) line data, 
wfiich render the same field, are converted into relevant so 
data items t»y referencing the LUTs 66a and 68bi 
Herein, the odd line data is the first CCD output 85a pro- 
duced at tiie low shutter speed, and tiie even One data 
is ttie second CCD output 89> produced at the high 
shutter speed. The data items are acfcted up by the ss 
adder 89. Thus, a dynamic range Is optimized. 
[0203] A video oi^ut signal processed to optimize a 
dynamic range is plotted as shown in the i^permost 



row in Rg. 20. OE denotes data rendering an odd field, 
wherein data r^esenting even lines is added to the 
data. EO denotes data rendering an even field, wherein 
data representing odd lines Is added to the data. 
[0204] As illustrated, data processed to optimize a 
dynarnic range is an ordinary interlacing video output 
signal. A signal output via the DSP 91 and D/A convert- 
ing circuit 92 can therefore be output to the ordinary TV 
monitor 63 as it is. 

P1205] IMext, the normal nnode will be descrS)ed. In this 
mode, the switching means 90 Is changed over to the 
A/D converting drcuit 67a. 

[0206] As mentioned above. In the normal mode, the 
interladng signal shown in Rg. 21 is produced based on 
the first CCD output 85a alone. The signal is output to 
the ordinary TV monitor 63 via the CDS/AGC circuit 
66a. A/D converting circuit 87a. switching means 90. 
DSP 91 . and D/A converting circuit 92 as it is. 
[0207] Aocofdng to this embodiment a progressive 
CCD is employed. A trst CCD output and second CCD 
output produced at different shutter speeds are proc- 
essed nonlbiearly and added up. Time, data processed 
to realize a wide dynanvc range can be produce during 
one field period (1760 sec). A vertical resolution will 
therefore not deteriorate. 

[0208] Moreover, the same progressive CCD m^ be 
read in different modes. A video output signal for a wide 
dynamic range mode or a video output signal for a nor- 
mal mode can t>e produced nterely by switching a 
switch. 

[9209] Furthermore, a video output signal produced 
by realizing a wide dynamic range is conformable to the 
interlacing. A TV monitor can be used for display in 
common between the wtde dynamic range mode and 
normal moda There Is tfie merit of cAxviating the neces- 
sity of preparing any special monttor. 
[0210] The present invention la not limited to the mode 
presented by this embodiment Needless to say. various 
variations and appfications can be constructed without a 
departure from the gist of tfie emtxxfiment 
[0211] As described so far. acconJing to tNs embodi- 
mem. an imatf ng apparatus whose vertical resolution 
win not be deteriorated can be realized. 

(Fifth EmbodimenQ 

[9212] Next, the fifth embodiment of the present Inven* 
tion wBl be described reference to Figs. 23 to 25. As 
shown in Fig. 23, an endoscopic innaging apparatus 101 
of this embodiment consists of a camera head 102. a 
scope 103, a Hght source unit 104. a CCU 105, and a TV 
monitor loa Spedfically, the camera head 102 has an 
imaging means incorporated therein. The scope 103 is 
connected to tite camem head 102. The light source 
urat 1 04 supplies illumination light to the scope 1 03. The 
CCU 105 processes a signal sem from the imaging 
means Incorporated in the camera head 102. The TV 
monitor 106 displays an image according to a standard 
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video signal processed by the CCU 105. 
10213) An d^ective 110 is located at the of the 
scope 103. A ^ngle system of relay lenses 111 extend- 
ing from the back of the objective 1 10 to the camera 
head 102 is incorporated in the scope 103. An object s 
image formed by the objective 1 10 is propagated by the 
system of retay lenses 111 and input to the imaging 
means in the camera head 102. Moreover, an ilfumina- 
tton light guide 107 used to tHumnnate an object with iRu* 
mination light is njnning through the scope 103. io 
(0214J When the endoscopic imaging apparatus 101 
is in usek the light guide 107 running through the scope 
103 Is, as shown in Fig. 23, coupled to the light source 
unit 104. Illumination light emanating from a lamp 104 in 
the Oght source imit 104 then passes through an aper- rs 
ture stop 104b. The illumination light is then converged 
byatens 104c, and routed to the end surface of the Sght 
guide 107 opposed to the lens 104c. 
[0215] The Olumination light is propagated to the 
scope 103 by way of the light ^ide 107. passed thmugh so 
the scope 103, and emitted fion^ard through the distai 
side of the scope 103. An object such as a patient*8 
body cavity is thus iOuminated. Light reflected from the 
Illuminated object Is converged by the scope 103. An 
object image is then propagated by the objective 110 29 
and system of reiay lenses 1 11 in the scope 103, and 
projected by the imaging meane in the camera head 
102. 

[0216] in the camera head 102. a pupil divider 1 12 is 
located behind the sole system of relay lenses 111. The so 
object image propagated t>y the system of relay lenses 
111 is divided into a plurality of images, or In this 
embodiment, two images. An image formation optical 
system 1 13 is located behind the pupil divider 1 12. thus 
facing (wo images provided by the pupil cSvider 112. ss 
First and second soiid'etate iniaging devices 114 and 
1 1 5 to be opposed to the two images are located behind 
the image formation optical system 1 ia 
f0217] In this embodiment, a CCD is adopted as the 
solid-state imaging devica The first and second solid* 4o 
state imaging de^es 114 and 115 wifl therefore be 
refeaed to as the first and second CCDs 1 1 4 and 115. 
Object images produced by bisecting the object inmge 
by means of the pupO divider 1 12 are fomted on the 
image planes of the first CCD 114 and second CCD 115 « 
respectively. The object images are then photoeiectri- 
cally converted. 

10218] CCD driving signals for driving the first CCD 
114and second CCD 115 are tnansmitted over two sys- 
tems of CCD driving seined transmission tines. CCD out- so 
put ^nals output from the CCDs are transmitted over 
two system of CCD output signal transmission Unas. 
The trarsmission Ones are contained in a camera cable 
108. and coupled to the CCU 105 via a camera coruiec* 
tor 109. The ou^ signals of the CCDs 114 and 115 55 
are sent to the CCU 105 and suk)jected to various Kinds 
of signal processing. A video signal output from the 
CCU 1 05 is sent to the TV monitor 106. A view image of 



an ot)|ect is then displayed on the TV monitor 106. 
10219] In the CCU 105. a first CCD drive circuit 121 
and second CCD tMve circuit 129 are incorporated as 
circuits for driving the first CCD 114 and second CCD 
115 respectively. The CCD drive circuits 121 and 129 
supply CCD driving signals to the CCDs 114 and 115 
respectfvety over the CCD driving signal transmission 
Ones in the camera cable 108. Charges of signals accu- 
mulated in the CCDs 114 and 115 are then read out 
[0220] Moreover, two signal processing systems are 
installed in the CCU 105 In order to handle the output 
signals of the first CCD 114 and second CCD 115 
respectively. To tsegin with, a processing system fbr 
handling the output signal of the first CCD 1 14 will be 
described. 

{0221] A preamplifier 124 is installed on an inttiai 
stage of the CCU 1 05. The transmission line over which 
the output signal of the first CCD 114 is transmitted is 
coupled to the preamplifier 124. A CCD output signal 
read from the CCD 1 14 is transmitted to the CCU 105 
over the CCD output transmission line in the camera 
cable loa A lose occunring during cable transmission is 
anplified by the preamplffier 124, vvherelsy given 
processing is carried out. 

(02221 On the stage succeeding the preamplifier 1 24. 
a CDS circuit and sample-and-hold circuit that are not 
shown are installed. The CCD output signal ampTrfied tiy 
the preamplffier 124 is pre^ocessed by the CDS (cor- 
relative double sampling) circuit and sample-and-hole 
circuit. 

(0223] On the stage succeeding these circuits, there 
are an A/D converting circuit 125 and digital signal 
processing circuit (DSP) 126. After the CCD output sig- 
nal undergoes the doove given pre-processing, K Is 
input to the AA) converting circuit 125 and then con- 
verted into a (figitai signal. Given dig^ signal process- 
ing is then perfbrmed on the digital signal tiy the digital 
signal processing circi^ 126. 
[0224] The digital signal processing dncuH 126 has the 
capabiGties of a cdor separating circuit, white balance 
circuit, and automatic gain control circuit Heren. the 
color separating circuit separates three color signal 
components of red. green, and blue signals from a digi- 
tized signal. The white balance circuit adjusts a ¥vhite 
balance detected in each of the color digital signals pro- 
vided by the color separating circuit The automatic gain 
control circuit contrcris a gain to be given to a digital sig- 
nal that has a wNte t>alance thereof adjusted by the 
white balance drouit The distal signal processing cir- 
cuit 126 carries out given digital signal processing. 
(02251 Moreover, on the stage succeeding the digital 
signal processing drcuit 126, there Is a knee and 
gamma circuit 127 for treating a knee detected by plot- 
ting each of processed digital signals and for conecting 
a gamma Indicated by each thereof. The Icnee and 
gamma circuit 127 is succeeded by a first ailthmetic cir- 
cuit 128. The first arithmetic circuit 128 e)q)ands 
dynarftic ranges for the red, green, and blue digital eig- 
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nals each of which has been piocessed to treat a knee 
and correct a gamma means of the knee and gamma 
ctrojit 127. The first arithmetic circuit 128 then 
enhances the resultant red, green, and blue digital sig- 
nals. 

CQ226] On the other hand, a waveform detecting drcuH 
123 for determining a shutter speed for the first CCD 

114 under the control of the digital signal processing cir- 
cuit 1 26 is connected to the digital signal processing cir- 
cuit 12a A timing generator (TO in the drawing) 122 is 
connected to the waveform detecting circuit 123. The 
first ceo drive circuit 121 and second CCD drive circuit 
129 for driving the first CCD 114 and second CCD 1 15 
respectively are connected to the timing generator 122. 
ffKt27] The waveform detecting circuit 123 is con- 
nected to a digital signal processing circuit 132 that wiO 
be described later, and therefore controOed by the dig- 
ital signal processing circuit 132. 

[0228] The waveform detecting circuit 1 23 detects the 
waveforms of digital signals produced bf the digital sig- 
nal processing circuits 126 and 132, and thus deter- 
mines the shutter speeds to be set for the first CCD 1 1 4 
and second CCD 1 15. The timing generator 122 gener* 
ates driving dgnals for use fri driving the first CCD 114 
and second CCD 115 according to an output signal of 
the wavefonm detecting circuit 1 23. 
[0229] Moreover, the forst CCD drive drcuit 121 and 
second CCD drive circuit 129 transmit CCD driving sig- 
nals used to drive the first CCD 1 14 and second CCD 

1 15 in response to a driving signal sent from the timirrg 
generator 122. At this time, the first CCD drive drcuit 
121 and second CCD drive drcuit 129 drive the first 
CCD 114 and second CCD 115 so that the first and sec* 
ond CCDs will image an obt^ct at mutually different 
shutter speeds. Specif icaily, the first CCD 1 14 is driven 
to image an ol^ect at a relatively low shutter speed, 
while the second CCD 1 1 5 is driven to bnage the object 
at a relaUvely high shutter speed. The driving control wUI 
be described later. 

[0230] The ecu 105 has a preanp^ier 130. an A/D 
comerting drcuit 131. a digital signal processing drcuit 
132. a knee and gamma drcuit 1 33. and a second arith- 
metic circuit 134. These drcuits fill the same rotes as 
the preamplifier 124. A/D convertirig drcuit 125, cfigital 
sigrmi processing drcuit 126. Imee and gamma drcuit 
127, and first arithmetic drcuit 126. This processing 
system irputs an output signal (tf the second CCD 1 15 
and carries out the same processing as that mentioned 
above. 

[0231] Moreover, the first arithmetic drcuit 128 and 
second arithmetic drcuit 134 are succeeded by an 
adder 135. a 0/A converting drcuit that Is not shown, 
and a posti>rocessing drcuit 136. 
[0232] The first arithmetic circuit 128 and second 
arithmetic drcuit 134 perform given processing on 
Image signals that are produced at mutually different 
shutter speeds by the first CCD 114 and second CCD 
115 respectively. The given processmg will be detailed 



later. 

[0233] Output signals of the first arithmebc drcuit 128 
and second arfthmetic drcuit 134 are added up to t>e 
thus synthesized by the adder 1 35. A resultant signal is 

5 converted into an analog signal by the D/A convertr^ 
drcuit, and then input to the post-processing drcuit 1 36. 
The post-processing drcuit 136 converts the resultant 
signal into a standard video signal. The video signal is 
then output to the TV monitor 1 06. 

10 ^34] Next, the operations of the endoscopic imaging 
apparatus 101 of this ennbodimeni having the ibregoing 
components wiH be described. 

In tNs embodiment an object image is propa- 
gated through the scope 103 by the system of relay 

16 lenses ill that is a sole optica) system. The object 
image then bisected by the pupil divider 112 in the 
camera head 102. Based on a driving signal generated 
by the timing generator 122. the first CCD 1 14 and sec- 
ond CCD 115 project the two equal object images pro- 

20 vided tyy the pupil divider 112 at mutually different 
shutter speeds. At this time, the shutter speeds are 
determined by the waveform detecting drost 123 under 
the control of the digital signal processing drcuit 128 
and digital signal processing drcuit 132. Namely, the 

25 first CCD 114 protects the image at a relatively low shut- 
ter speed, wHIe the second CCD 115 pit^ects the 
image at a relatively high shutter speed 
[0236] More particulariy. the first CCD 1 1 4 is drfv^ to 
project the object image at a relatively low shutter speed 

so of. for example. 1/60 sec (first exposure time). The sec* 
ond CCD 1 1S is driven to project the object image at a 
relatively high shutter speed of 1/240 sec (second expo- 
sure time). 

10237] As ntentioned at)Ove. the first CCD 114 and 

3$ second CCD 115 project the two equal <^ect images 
provided by the pupil divider 112 at mutually different 
shutter speeds. The f&st CCD 114 and second CCD 
1 15 then transmit con'esponding photoelectrically-con- 
verted signals to the preamplifiers 124 and 130. CCD 

40 output signals amplified by the preamplifiers 124 and 
130 are st^ected to given processing by means of the 
aforesaid two ^rstems of drcuits. The first arithmetic dr- 
cuit 128 and seoorxi arithmetic circuit 135 apply given 
weights to image signals produced by the first CCD 114 

4S and second CCD 1 15 respectively The image signals 
produced by the first CCD 1 14 and 
00238] second CCD 1 15 are thus processed property 
by the first arithmetic drcuit 128 and second arithmetic 
drcuH 135. Thereafter* the Image signals are added up 

60 by the adding circuit 135^ and then output to the suc- 
ceeding stage. 

(0239] Weighting of the image signals by the f iiKt arith- 
metic ciroAt 128 and second aritiimetic dront 134, and 
synthesizirtg thereof by the adcfing drcuit 135 will be 
66 described with reference to Rga 24 and 25. 

[0240] Fig. 24 is a timing chart showing the relation- 
ships among a vertical sync signal, image signals, and 
a synthetic picture dgnal. Her^n. the vertical sync dg- 
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naJ is output from the timing generator 122. The image 
signals are actually produced by the first CCD 114 
(driven at a Iomt shutter speecQ and second CCD 115 
(driven at a high shutter speed). The synthetic picture 
signal is produced l>y the adding drcuit 135. FtQ. 25 s 
graphlcaU/ shows the output levels of image signals and 
the output level of a synthetic picture ^gnal in relation to 
an amount of incident fight. Herein, the image signals 
have been output from the first CCD 1 14 (driven at the 
\OM shutter speed) and second CCD 115 (driven at the r o 
high shutter speed), and we^hted with difterent 
we^hts. The synthetic picture signal is produced by tiie 
adding drcuit 135. 

[QSM1 ) As shown in Fig. 24. the image signal produced 
by the first CCD 114 during a first exposure time equiv- is 
alent to the low shutter speed (1/60 sec) shall be x. 
Moreover, the inr»ge signal produced by the second 
CX^O 115 during a second exposure time equivalent to 
the high shutter speed (1/240 sec) shall be u. The syn- 
ttietic picture signal produced by the adding circuit 135 20 
shall beM. 

(0242) In this embodiment the image signal produced 
bythefir5tCCDll4isweightedtvcos^(px) by means 
of the first arithmetic drcuit 128. In other words, when a 
luminance level is Ibw, the image signal produced by the 2S 
first CCD 1 14 during tfie first eoqposure time (1/GO 8e<9 is 
weighted. Incidentally, p denotes a correction ooeffi* 
dent Assuming that a brightness level at which the 
image signal produced t>y the second CCD 1 15 during 
the second exposure time (1/240 sec) has a saturation $0 
value is s, the conrection coeffident p is approximately 
Ph(6 • n/2} . For example, p » nA8 . 
(0243] Moreover, the second arithmetic CffcuH 134 
applies a w^ht of sin^^x) to the image signal pro- 
duced by the second CCD 115. In other words, when a ss 
luntlnance level is high, the image signal produced dur- 
ing the second &qposmB time (1/240 sec) by ttia second 
CCD 115 is weighted. 

PI244] On the other hand, the adding circuit 135 adds 
up the image signals produced by the first CCD 1 14 and 40 
second CCD 115 and processed as merttioned above 
bjf the first arithmetic drcuit 128 and second arithmetic 
drcuit 1 34. A thus produced synthetic picture si^iai M Is 
expressed as fbllows: 

45 

M a xcos^(px) ♦ usln^(p34 

(0245] The synthetic picture signal M exhibits the 
characteristic grapNcaOy shown h% Rg. 25. Thus, a 
dynamic range can be expanded without any deteriora- so 
ikm of a signal<lD-noise ratio of a signal component indi- 
cating a low luminance level. 
[0246] Moreover, the correction coefficient p should 
merdy be set properly relative to x. The synthetic pic- 
ture signal M varies as a function that increases monot- ss 
onousty within a range of brightness levels up to a 
brightness level at which the signal produced during the 
second exposure time has the saturation value. Cor«e- 



cpiently, a constructed Image appears unitorm but gives 
no sense of hoongiuhy. 

[0247] In this etnbodlment. the correction coeffident p 
is approximately n/B. Aside from it the correction coeffi- 
dent p may be set to any value according to the charac- 
teristics of the first CCD 1 14 and second CCD 1 1S. In 
this case, the synthetic picture signal M varies with x as 
a function that inaeases monotonously. 
(0248] Moreover, the synthetic picture signal M need 
not vary as the above function, that is: 

xcos^(p30^usin^(px) 

(0249] Alternative^, the synthetic picture signal M may 
vary as a function that has a value dominated by a sig- 
nal, which is produced at the low shutter speed, relative 
to a low luminance level, and that has a value dorrn- 
nated by the signal, which is produced at the high shut- 
ter ^ed. relative to a high luminance level. 
l!02Sa\ As described above, according to this embodi- 
ment, there is provided an endoscopic imaging appara- 
tus that offers an expandable dynamic range for an 
fanage signal without any deterioration of a signal*^ 
ndse ratio of a signal component indicating a low lumi- 
nance level. Moreover, the endoscopic imaging appara- 
tus can construct a smooth image gKring no sense of 
incongruity. 

(Sixth Embodiment 

(0251] The sixth entfKxfiment of the present invention 
wiO be described with reference to Figs. 26 and 27. As 
shown in Rg. 26. an imaging apparatus 150 of the sixth 
embodiment consists of a CCD 151. a sync signal gen- 
erating drcuit (hereinafter. S8G) 157, a tMng genera- 
tor (T/Q in the drawing) 156. and a CCD driver (CCD 
DRV in the drawing) 155. The CCd 161 is a slnglei^late 
color imaging device for imaging an object The sync 
dgnal genemting drcuit 157 generates a reference sig> 
nal. The tinrung generator 156 tnpids the reference sig- 
nal from the SSQ 157 and produces a drivnig ^gnad for 
use in driving the CCD 151. The CCD drKrer 155 drives 
the CCD 151 in response to the driving signal sent f^ 
eie timing generator 156. 

PS252] The imaging apparatus 150 further consists of 
a preamplifier 152, a correlative double sanpfing 
(abbreviated to CDS) drouit 1S3. and an A/0 converter 
154. Specifically, the preamplifier 512 amplffies an 
bnage signal produced by the CCD 151. The CDS dr- 
cuit 153 canles out con'elative double sanrpiing accord- 
big to sampling pulses sent frm the timing generator 
156. The A/D converter 154 cfigttizes an output of the 
CDS drcuit 153. An inriage signal output from the CCD 
151 is anplif ied by the preamplifier 152. Thereafter, the 
frequency of the resultant signal is lowered to fall within 
the baseband by the CDS circuit 153. The signal is then 
digitized by the A/D converter 154. 
10253] Moreover, the imagang apparatus 150 includes 
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a (ow-^ulier speed setting unit 161 and a high-sttutter 
speed setting unit 160. The low-shutter speed setting 
unit 161 sets the shutter speed for the CCD 151 to a low 
shutter speed, for example* about 1/60 sec The high- 
shutter speed setting unit 160 sets lha shutter speed for 
the CCD 151 to a shutter speed equivalent to a submut^ 
tipie of n o1 the shutter speed set by the (ow-shutter 
speed setting unit 161. Note that tfte shutter speed is 
equivalent to an exposure tima 
[0254] Thus, the data of shutter speeds is output ftom 
the (ow-shutter speed setting unit 161 and high-shulter 
speed setting unft 160. Either of the shutter speeds Is 
selected hy a shutter speed selection switch 1 59 that is 
cfianged over to a different drcuit for each field period 
according to a reference signal sent from the SSG 157. 
[0255} On the other hand, an output of the A/D con- 
verter 154 is sent to a video signal processing unit that 
is not shown. A waveform detecting circuit 158 is con- 
nected to the output terminai of the A/D converter 154. 
The waveform detecting circuit 158 detects the wave- 
fbrm of only an image signal produced by the CCD 151 
at the low shutter speed aocordino to a field judgment 
signal sent from tfie timing generator 156. The result of 
waveform detection Is output to the low-shutter speed 
setting unit 161. 

[0256] The low^utter speed setting unit 1 61 sets a 
shutter speed according to the result of waveform 
detection performed by the waveform detecting drci^ 
158. thus optimizing the level of ti^e image signal pro- 
duced by the CCD 151. 

[0257] Next, the operations of the imaging apparatus 
of tills embodiment having the foregoing oomponents 
will toe described witii referertce to Rg. 27. 
[0258] With a driving signal generated by the timing 
generator 1 56 according to the reference signal VO sent 
from tfie SSQ 157. the CCD driver 1S5 drives the CCD 
151. At tills time, control is given to set a shutter ^eed 
for ttie CCD 151. Namely, tiie low shutter speed set by 
the low^utter speed setting urUi 161 and the Ngh shut- 
ter speed set by tfie hlgh^hutter speed setting unit 160 
are SMrltched for each field period. 
[02S9] Moreover* the wavefbrm detecting circuit 1 58 
detects tiie waveform of only an Image signal produced 
at the low shutter speed set by the low-shutter speed 
setting unit 161. The low-shutter speed setting unit 161 
sets a shutter speed according to a result provided by 
the waveform detecting circuit 158, thus optimizing the 
level of the image signal produced fay the CCD 151. 
P260] On the other hand, a high shutter speed to be 
set by the high-shutter speed setting unft 160 tea sub* 
multiple of n of ttie shutter speed set by the low-shutter 
speed setting unit 161. For example, a quarter of the 
shutter speed is adopted. 

[0261] A photoelectrically converted signal represent- 
ing an object image projected by the CCD 151 is ampli- 
fied by the preamplifier 152. The frequency of the 
resultant signal is then lowered to f^l within the base- 
band by means of the CDS circuit 153. The signal is 



tiien converted into a digital signal by the A/D converter 
1 54. and output to the video signal processing unit that 
isnotshowa 

[0262] As mentioned above. acocsdinQ to tHs embod- 

5 the imaging apparatus 150 has ti>e wav^orm 

detecting circuit 158 ttiat detects the waveform of only 
an image signal produced at tite tow shutter speed set 
by the lo«v-shutter speed setting unit 161. Based on the 
result of waveform detection peitormed by tiie wm* 

10 form detecting circuit 1 58, the low-shutter speed setting 
unit 161 controls the shutter speed fbr the CCD 151. At 
titts time, the shutter speed for the CCD 151 is control- 
led In order to epSwize the level of an image signal pro- 
duced by tiie CCD 151. The high-shutter speed setting 

IS unit 160 autonomously sets a htgh^ shutter speed than 
the shutter speed set by the tow>shutter speed setting 
unh 161. Consequently, an iris diaphragm can be real- 
ized for tiie CCD. Despite the relatively slmpte circuitry, 
tiie imaging apparatus can offer a wide dynamic range 

20 tor an image signal. 

[0263] In this embodiment a shutter speed set by the 
high'Shutter speed setting unit 160 is automatical^ s^ 
to a quarter of a shutter speed set by the low-shutter 
speed setting unit 1 61 . rtoedless to say, the submultfple 

SB Of n Of the shutter speed set by tiie low-shutter speed 
setting unit 161 is not limited to the quarter tfiereof. 

(Seventh Enrtodiment) 

30 [0264] l^ext the seventh embodiment of the present 
invention will be described witii reference to Figs. 28 
and 29. 

[0265] The basic configuration of an imaging appara- 
tus 1 50* of ttie seventtt embocfiment is identical to that of 

15 tiie sixth embodiment 

10266] How9rer. aocoiding to ttte siidh embodiment 
ttte waraform detecting circuit 158 detects ttie wave- 
form of only an image signal produced by a low-shutter 
speed. The low-shutter speed setting unit 161 controls a 

40 shutter speed according to the result of waveform 
detection performed by ttie waveform detecting circuit 
158. The high-shutter speed setting unit 160 autono- 
mously sets a shutter speed aoconding to the shutter 
speed set by ttie low-shutter speeA setting unit 161. 

45 According to tills embodiment, unlike the sixtii embodi- 
ment the waveform d^ecting drcuit 156 detects tt)e 
waveform of only an Image signal produced at a high 
shutter speed set by the high-shutter speed setting unit 
160. Based on the result of wavefbnm detection per- 

so fbrmed by the waveform detecting circut 1 58. the Hgh- 
shutter speed setting unit 160 controls a shutter speed 
so as to optimize ttie level of an image signal produced 
by ttie CCD 1 51 . The fow-shidter speed setting unit 161 
sets a shutter speed according to ttie shutter speed set 

66 by ttie high-shutter speed setting unit 160. 

[0267] Herein, a mention wiO ttierefore be made of 
only a deference from ttie sixtti embodiment. The 
description of a duplicate portion will be omitted. 
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[0268] An imaging apparatus 1 50' of this enibodiment 
shGNvn in Rg. 28 consists of a high-shutter speed setting 
unit 160 and a low-shutter spaed setting unit 161. Spe- 
etfically« the high-shutter speed setting unit 160 sets the 
shutter speed for the CCD 151 to a Ngh shutter speed, 
tor example, about 1/240 sec. The tow-shutter speed 
setting unit 161 sets the shutter speed for the CCD 151 
to a submultiple of n of the shutter speed set by the 
high-shutter speed setting unit 160. Note tat the shut- 
ter speed is equivalent to an exposure time. 
[0269] Thus, the data of shutter speeds is output from 
the low-shutter speed setting urtit 161 and high-shutter 
speed setting ur^t 160. Either of tfte shutter speeds Is 
selected by a shutter speed setectidn switch 159 that is 
changed over to a different circtut for each field period 
according to a reference signal sent from the SSG 157. 
A selected shutter speed is output to the timing genera- 
tor 156. 

[0270] By the way. the waveform detecting circuit 1 58 
of this embodmient detects the waveform of only an 
image signal, which is produced at a high shutter speed 
by the CCD 151. according to a field judgment signal 
sent from the tMng generator 156. The result of wave- 
form detection is output to the high-shutter speed set* 
ting unit 160. 

[0271] Based on the result of wavefbnm detection per- 
formed by the wavefonn detecting circuit 158. the high- 
shutter speed setting unit 160 sets a shutter speed so 
as to optimize the level of an image signal produced by 
the CCD 151. 

[0272] Next, the operations of the imaging apparatus 
of this embodiment having the foregoing components 
win be described with reference to Fig. 29. 
[0273] The timing generator 156 generates a driving 
signal according to a reference signal VD sent from the 
SSQ 157. Wfth the driving signal, the CCD driver 155 
drives the CCD 1 51 . The shutter speed for the CCD 1 51 
is controQed by switdiing for each field period a high 
shutter speed set by the high-shutter speed setting unit 
160 and a low shutter speed set by the low-shutter 
speed setting unit 161 . 

[0274] The wavefonm detecting circuit 1 58 detects the 
wavefonm of only art image signal produced at the high 
shutter speed sat by the high-shutter speed setting unit 
160. Based on the residt of waveform, detection per- 
formed the waveform detecting circurt 158, ^e high- 
shutter speed setting unit 160 sets a shutter speed so 
as to optindze the level of an image signal produced by 
the CCD 151. . 

[0279 The low shutter speed set by the low-shutter 
speed setting unit 161 is automatically set to a multiple 
of n of a shutter speed set by the high-shutter speed 
setting unit 160, for exampie, a quadruple thereof. 
[0276] A photoelectricaQy converted signal represent* 
ing an ot^ect image produced by the CCD 151 is ampti- 
fted by a (Dreampiifier 152. Thereafter, the frequency of 
the resultant signal is lowered to f^l within the t)ase- 
band by means of a CDS drcuit 153. The signal is then. 



converted into a digital signal by an A/D converter 154. 
and then output to a vUeo sigral processing unit that is 
not shown. 

19277] As mentioned ak)ove. even in the inraging 
s apparatus 150' of this emtuxfiment. ilke that of the sixth 
embodiment, an iris diaphragm can be realized for the 
CCD. Despite the relatively stn%AB circuitry, the imaging 
apparatus can offer a wide dyrtamic range for an Image 
signal. 

10 [0278] Even in this embodiment, a shutter speed set 
tqr the tow-shutter speed setting imit 161 is a quadn^e 
of a shutter speed set by the Ngh-shutter speed setting 
ur^ 1 60. Naturally, the muKlde of the shutter speed set 
by the high-shutter speed setting unit is not fintited to 

1$ the quadruple thereof. 

(Eighth Entxxfimenf) 

[0279] Next, the eighth embocfiment of the present 
20 invention will be described with reference to Rgs. 30 
end 31. 

10280] The same reference ruimerals wilt be assigned 
to components identical to ttiose of the sixth and sev- 
enth embocfimenta. The descr^tlon of the components 

2s wiHbeomitted. 

I0281I In the Imaging apparatuses 150 and 150* of the 
sixth and seventh enrtxxfimem. the waveform of either 
an image signal produced at a low shutter speed or an 
image signal produced at a high shutter speed is 

so detected. Either the low shutter speed or high shutter 
speed Is set based on the result of waveform detection. 
The other shutter speed is set to a certain ratio of the 
set shutter speed. 

[0282] Unlike the Imaging apparatuses of the embod- 

3$ iments, an imaging apparatus 1 50" of this embodiment 
detects the waveform of an image signal produced at a 
low shutter speed and that of an Image sfgnal produced 
at a high shutter speed. The high-shutter speed setting 
unit 160 ar)d low-shutter speed setting unit 161 each set 

40 a shutter speed. 

[0283] As shown in Fig, 30, the Imaging apparatus 
ISO" of this embodiment includes a Ngh-shutter speed 
setting unit 160 and a low-shutter speed setting unit 
161. The high-shutter speed setting unit 160 sets the 

45 shutter speed for ttie CCD 151 to a high shutter speed, 
for example, about 1/240 sec. The low-shutter speed 
setting unit 161 sets the shutter speed tor the CCD 151 
to a low shutter spaed, for example, about 1^ sec. 
10284] Ihua, the data of shutter speeds is output from 

90 the low-shutter speed setting unit 181 and hi^vshutter 
speed setting unit 160. Eittier of the shutter speeds is, 
like those in the sheth and seventh embodiments, 
selected by a shutter speed selection switch 162 that is 
changed over tor each field period according to a refer- 

£f encB signal sent from the SSO 157. The data of the 
selected shutter speed is then output to the tinting gen- 
erator 156. 

I028Q On the other hand, the waveform detecting dr- 
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cuft 158 of this embodiment detects the waveforms of 
image slonals produced tiy the CCD 1 51 aocording to a 
field judgment s^nal sent from the timing generator 
156. Her^. one of the image signals has been pro- 
duced at a high shutter speed, and the other image sig- $ 
nal has been produced at a low shutter speed. The 
results of waveform detection are output to ether tfte 
high-shutter speed setting unit 160 or low-shutter speed 
setting iiiit 161. Either the high-shutter speed setting 
unit 160 or low-shutter speed setting unit 161 is io 
selected by a shutter setting unit selection switch 163 
that is changed over for each fieU period according to 
the reference signal sent from the SSQ 157. 
[0286] The high-shutter qpeed setting unit 160 or tow- 
shutter speed setting unit 161 is selected by the shutter is 
setting unit selection switch 163. At tNs time, based on 
the results of waveform detection performed by the 
wavefomi detecting circuit 156. a shutter speed is deter* 
mined in order to optimize the level of an image signal 
produced by the CCD 1 51 . 20 
[0287] Next, the operations of the imaging apparatus 
150" of this embodiment having the foregoing compo- 
nents will be descritied wth reference to Fig. 32. 
(0288] The timing generator 156 generates a driving 
signal acconling to a reference signal VO sent from the 25 
SSQ 157. V^Tith the driving signal, the CCD driver 155 
drives the CCD 151. At this time, the shutter speed for 
the CCD 151 is controlled so that a high shutter speed 
set by the high-shutter speed setting unit 160 and a low 
shutter speed set txy the low-shutter speed setting unit so 
161 will k>e switched for each field period. 
[0289] Moreover, the waveform detecting circuit 158 
detects the waveforms of tsoth an image signal pro- 
duced at the high shutter speed and an image signal 
produced at the low shutter speed. The results of wave* 95 
form detection are output to either the high-shutter 
speed setting unit 160 or low-shutter speed setting unit 
161 selected liy the shutter setting unit selection switch 
163. 

[0290] A shutter setting unit selected by the shutter 40 
setting unit selection switch 163 determines a shutter 
speed according to results provided tf/ the wavefomi 
detecting drcuit 158. In other words, a shutter speed is 
determined in order to optimize the level of an image 
signal produced by the CCD 151 . 45 
[0291] A photoelectrically converted signal repre8en^ 
ing an object image produced by the CCD 151 is ampli- 
fied by the preamplifier 152. Thereafter, the frequency 
of the signal is lowered to fall within the baseband 1^ 
means of the CDS drcuit 153. The resultant signal Is so 
converted into a digital signal by the A/D converter 154. 
The digital signal is then output to the video signal 
processing unit that is net shown. 
[0292] As mentioned above, accordi ng to this embod- 
iment the imaging apparatus 150" can offer an optimal ss 
dynamic range for an image signal according to the 
brightness levels of an object. Even an object that may 
be visualized with a quite bright portion and quite dark 



portion thereof coexistent on the same saeen can be 
imaged without oocurrme of any drawt>ack such as 
streaky vvhitening or tiladcening. 
[0293] In tie sixth to eighth embodiments, imaging at 
a low shutter speed and imaging at a fvgh shutter speed 
are switched for each field period that is defined the 
timing generator 156. The present invention is not Om- 
ited to this mode. Altematively, as shown In Rg. 32. 
imaging at the low shutter spaed may be repeated over 
a plurality of field periods. 

ffiid^ When iiittglng at the low shutter speed is car- 
ried out in a long exposure mode, a proper dynamic 
range can be offered even for a very dark object In this 
example, the wavetorm detecting drcuit 156 can be 
exduded. 

[0295] As mentioned above, according to the sixth to 
eighth embodiments, there is provided an endoscopic 
imaging apparalus capable of constructing an appropri- 
ate image even when the brightness level of an object 
varies widely. 

(Ninth Embodiment) 

10296] Next the ninth embodiment of the present 
invention wiO be described with reference to Figs. 33 to 
40. An endoscopic imaging apparatus 201 of the ninth 
emfcxxfiment of tiie present invention w3l be descrit>ed 
in conjunction with a schematic configuration shown In 
Rg. 33. 

(0297] In the endoscopic imaging apparatus 201 . light 
reflected from an object of observation 202 falls upon an 
imaginQ unit 204 through an optical path 203. An expo- 
sure value control means 205 in the imaging unit 202 
controls an amount of incident light reflected tnm the 
object of okKsrvation 202. For constructing one frame 
Images the amount of incident light is controlled so that 
an oqM)sure value wai be different between two field 
periods^ Thus, an eatposure value for the imaging sur- 
face of an imping device 206 is controlled. 
[D298] The ocposure value control means 205 sMs the 
exposure value for the imaging surface so that an image 
prone to streaky whitening (halation) will be formed dur- 
ing a first field, and an image prone to sHgtYt blackening 
(biaddng out) wilt t>e formed during a second field 
period. 

[0299] An image processing unit 207 includes a s^nai 
generator 298 for generating a timing signal used to 
switch the actions of the exposure value control means 
205 acoofding to given timijig. Herein, a tinting signal 
used to cfiange e)9X)8ure values for each field rendered 
t>y a v^eo signal is sent to the exposure value control 
means 20s. 

[0300] in the image processing unit 207. an ampfifier 
209 amplifies an image signal that has k>een photoelec- 
trically converted by the imaging device 206 and input to 
the image procesdng unit. Thereafter, an image 
processing circuit 210 syn^esizes signals, which 
render a first field and second field, according to a given 
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algorithm, thus producing a video dgnal. 
[0301] In synthesis for producing a video signal, a tim- 
ing signal sent from the signal generator 208 is used to 
lock the timing of an image signal produced by the 
imaging de^e 206 onto the timing of a reference sig- s 
nal A video signal produced is output to an image dis- 
play 212 such as a CRT monitor via a video output 
circuit 211 . An Image of the ol^ect off observation 202 Is 
then displayed. 

[0302] Owing to the foregoing conponents, a rela- io 
tively dark portion of a vieMT image Is displayed based on 
an image signal that renders a first field and ie prone to 
streaky whitening* Moreover, a relatively bright portion 
thereof is displayed based on an image signal that 
rendo's a second field and ts prone to blackening. Con- is 
seqiiently. the view image is seen clearly proving a wide 
dynamic range, in other words, it wiD not take place that 
blackening sterns from an farisufficient amount of Kght 
and streaky whitening stems from an excess amount of 
fight. 20 
[0303] Fig. 34 shows a oonf juration of an endoscopic 
imaging unit 204A as a practical exanple of the imaging 
unit 204. The endoscopic Imaging unit 204A consists of 
an optical endoscope 215. and a camera head 216 or 
TV camera mounted on the optical endoscope 21& The 2S 
optical endoscope 215 has an elongated insertion unit 
217 that is inserted into a body cavity or the like. 
[0304] A light guide 218 for propagating illumination 
light is running through the insertion unit 217> The prox- 
imal end of the light guide 218 is coupled to a light so 
source unit 220 through a light guide cattle 219. Thus, 
illumination light emanating from a tamp 222 that glows 
with power supplied from a lamp power supply circuit 
221 is converged by a lens and then supplied. The illu- 
mination li^ is propagated and emitted through the ss 
distal end of the light guide 218. Consequently, an 
oblect 223 that is the object of observation 202 is iOiOTil- 
nated. 

I030S] Light reflected from the object 223 illuminated 
by the illumination Tight is passed through an objective 4o 
optical system 224 located at the distal end of the inser- 
tion unit 21 7. An optical image of the object is formed on 
the distal surface of an image guide 225, and propa- 
gated to the back surface of the image guide 225 by 
means of the irnage guide 225. The optk^l onage pr(^- 48 
agatad to the t>ack surface Is prdected on a CCD 228 
placed as the Imaging device 206 on the Image plane of 
an image formation lens 227. 
10306] A mosaic filter 229 tor separating ootor compo- 
nents is attached to the Imaging surfiace of the CCD so 
22B. When a CCD driving signal generated by the signal 
genemtor 208 Is applied to the CCD 228. a photoelectrl- 
cally oonv^ed picture signal is output 
[0307] According to this ennbodlment a disk-tike ftiter 
memt>er 231 Is placed as the exposure value control 55 
means 205 on an optical path linMng the image fbrma« 
tion lens 227 and CCD 228 The filter member 231 is 
driven to rotate by means of a motor 232 that rotates 



with a cfrivfng signal sent from a motor control circuit 
233. A f iekf judgment signal whose level differs between 
a fifstfi^ and second fiekl is input to the motor control 
drcuH 233. The motor control drcuH 233 coittrols rota- 
tion of the motor so that two f Bteis 234a and 234b of the 
filter merr^ 231 . which are shown in Fig. 35A. wfll be 
placed on the optical path alternately for each field. 
Thus, an amount of imaging fight to be projected on the 
CCD 228 is controlled f idd by field. 
10308] lnotherwords,a86hownlnRgs.35Aand35B, 
thefilter member 231 is composed of two kinds off Stem 
Fa and Fb shaped semi-circularty and mutually different 
in tmnsmHtance. An axial member Is extended from the 
center of the filter member 231 in a normal direction. 
The other end of the axial member is fitted in the motor 
232. Thefilter member 231 is therefore rotated together 
with rotation of the motor 232. 
[0309] A description will proceed on the assumption 
that one of the two kinds of filters Fa and R> of the filter 
member 231 exhibiting diff^ent characteristics, that is. 
the filter Fa offers a higher transmitlance than the filter 
Fb. 

[0310] In this case, as menttoned above^ an image 
signal rendering a first field Is produced to be prone to 
streaky whitening. An image signal rendering a second 
field is produced to be prone to t)lackening. The motor 
232 is driven so that the filter Fa wffl face the InrBging 
surface of the CCD 228 during a first field period, and 
the filter Fb win face it during a second field period. 
[031 1 ] In other words, the motor 232 is made one turn 
during one frame period. The fitter Fa faces the imaging 
surface during a first half of the frame period, that is. a 
first field period. The filter Fb faces the imaging surface 
during a second field p&lod. 
(0312] . The transmission characteristics of the two 
Wnds of fatvs Fa and Fb vary depending on the state of 
an object to be imaged. Assume that an amount of light 
reflected from an object of observatton remains con* 
stant In Ms case, the amount of light reflected from the 
object of observation is aO projected on a portion of the 
imaging surface of the CCD 228 used to render a first 
field. For exanple, a several submuWple of the light 
reflected from the object of observation, or a several 
tens submUtiple thereof Is prelected on the other por- 
tion thereof used to render a second field. For the same 
oksject 23. two inures rendering the first f iekJ and sec- 
ond field are projected wHh different amounts of Rght. 
01313] In this embodiment, normally adopted condi* 
tions for imaging (lor example, one frame Imag^g 
perkxt is 1 ^0 sec. and each Md period is 1/60 sec) are 
satisfied. The relative transmission characteristics of 
tfie filters Fa and Fb are differentiated from each other 
Nevertheless, images can be projected with an expo- 
sure value nade greatiy cfifferent between them For 
projecting images with an ei^josure value made greatiy 
different between them, the transmission characteristics 
of the fitters Fa and Fb should merely be differentiated 
from each other. 
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(0314] Imaging is thus controfled. Consequently, wtien 
the f Oter Fa exists on the optical path, an amount of light 
passing through the filter member 31 (that is, an amount 
of light Incident on the CCD 228) varies according to a 
characteristic curve A in Rg. 36. When the filter Fb 5 
exists on the optical path, an amount of Gght passing 
through the filter meirter 231 varies according to a 
characteristic curve B in Fig. 36. 
[0315] Since imaging is thus controlled, a field judg- 
ment signal (See Fig. 37A) output from the signal gen- 10 
erator 208 incorporated In the image processing unit 7 
is Input to the motor control circuit 233. As shown in Rg. 
378, control Is given so that the filter Ri wiO be located 
on the optical path during a first field period and the fSter 
Fb will be located thereon during a second fieid period, is 
As shown in Fig. 37C. when the titer f=a is located on 
the optical path, an amount of incident light is larga 
When the fitter Fb is located on the optical path, an 
amount of incident light is smaller. 
{0316] Consequently, different images are projected 20 
with d'rffererrt amounts of light during the first and sec* 
ond field periods. 

10317] A signal processing system for displaying a 
constructed image on the image display 212 such as a 
typical TV mora'tor will be described below. ss 
10318] Image signals produced as mentioned above 
to render fields are processed by the image processirrg 
unit 207. Rg. 38 shows a conf iguration of a video proc- 
essor 237A as a practical example of the image 
processing urtit 207. so 
(0319] A ceo driver 24 1 operates synchronously with 
a timing signal generated by the timing generator 240. 
The ceo driver 241 applies a CCO driving signal to me 
CCD 228 at the start of each field period. An optical 
image projected on the imaging suriiace of the CCO 228 35 
during each field period is photoeleelrically oonverted. 
Charges accumulated during cine field period to serve 
as a signal are read from the CCO 228. An output signal 
is amplified by an ampim^ 242. and then passed 
through a pre-processor A/0 converter 243. Pre* 4o 
processing such as correlative dout^e sampling is car- 
ried out in order to extract signal components. The 
resultant signal is then digitized. 
(0320] Thereafter, the signal is input to a dynamic 
range expander 244 that carries out wide dynamic 4S 
range processing. After the wide dynantic range 
processing is completed, a color separation and white 
balance and AQC unit 245 carries out color separation. 
wWte balance adjustment, and AGC. Thereafter, a 
resultant signal is output to an external fnonitor or the so 
tike via a 0/A converter post-processor 246. 
[0321] The color separation and white balance and 
AOC unit 245 has a frame memory. A field signal is read 
from the frame memory according to^ for example, the 
interlacing. On a stage succeeding the unit 245, the sg- ss 
nal is converted into an analog signal and output as a 
conposite video signal conformable to the IsfTSC Alter* 
nativety, the signal may not be output as a composite 



video signal oontormabie to the NTSC but may be out- 
put as red, green, and blue signals. 
(P322] Rg. 39 shows a practical example of the 
dynamic range expander 244 shown in Fig. 38. Rgs. 
40A to 400 are tinting charts for explaining the actions 
of the dynamic range expansier 244 shown in Rg. 39. 
(ncidentally. VO in Rg. 40 denotes a vertical sync signal. 
[0323] A digitized video signal input to the dynamic 
. range eiqpander 244 shown in Rg. 39 is input toa frame 
memory 247. (In Rgs. 40C and 400. An and 6n denote 
signals produced during first and second field periods of 
the n*th frame period.) The video signal la also input to 
first and second selectors 248a and 248bi 
(P324] The video o'gnal input to the frame memory 
247 is input to the first and second selectors 248a and 
248b on a flrst-^ first-out (FIFO) basis. Namely, input of 
the signal to the second selector lags behind by one 
field period (See Rgs. 40C and 400). In other wc^ds. 
output of the signal from the second selector lags 
behind t)y one field period. The signal is therefore out- 
put synchronously with a tignal renderirtg a subsequent 
field 

[03251 A field judgment signal shown in Rg. 40B is 
Input directly to the first selector 248a but input to the 
second selector 248b via a reversing drowt 249. With 
the field judgment signal as a reference, either of sig- 
nals rendering first and second fields and exis^g in the 
selectors is fetched. 

[0326] A signal input to the first selector 248a Is output 
to a first muttiptier 250a. RrBt and second look-t4> tables 
(LUTs) 251a and 251b are referenced based on the sig- 
nal. The signal is then weighted with appropriate tunc* 
tons. 

[0327] The funcfions are, for example, as shown in 
Rgs. 40E and 40F. co$^(p6) residing in the first LUT 
251a and 8ln'(pB) residing in the second IXJT 251b. 
The variable pB in the function cos or sin varies with a 
brightness level 8 of an obfecl ranging from 0 to ic/2, 
though It <iBpBivSs on the parameter p for converting 
one scale to another. Herein, the brightoess level B is 
equivalent to a luminance level of a pixel to k>e produced 
virith a limited amourtt of incident ligtit An image signal 
produced under the condition ttiat an amount of incident 
light is linuted is employed. This is t>ecause when an 
image si^ial produced uruler any other condition is 
employed, the image signal may have a saturation 
value. Thus, the image signal produced with a limited 
amount of inoderrt light is employed in order to avoid 
use of such an Image signal having a saturation valua 
(0328} co8(f}6) Is a function that decreases monoto* 
nously relative to a brightness level of an otject 
8in(pB) is a function that increases monotonously. 
Squares of the functions exfvbit the similar characteris- 
tics. In this case, the sum of the squared f uitctions is 1 . 
[0329] Signals weighted tfy referencing the f^st and 
second LirTs 251a and 251b are output to the first and 
second multipliers 250a and 250b. The signals are then 
nuiltiplied by outputs of the first and second selectors 
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2468 and 248bL Theraafter. outputs of the first and sec* 
ond muttipDers 250a and 25Cb are added up by an 
adder 252. A resultant signal is output from the dynamic 
range expander 244 as shown in Fig. 400. 
[0330] As menttoned above, tno images constituting 
one frame and projected with different amounts of flght 
during two field periods are synthesized with eadi othsr 
in order to construct one inmge rendering the one 
fiama A sqinal proving a wide dynamic range is thus 
produced, and output to an external monitor or the fike 
via a processing system on a succeeding stage. 
[0331 ] As mentioned above, two images are projected 
on the imaging surfaces of the CCD 228 with different 
amounts of light, which are defined by the filters Fa and 
Fb, during two field periods that are mutually identical 
ima^ng periods. Signals representing the Images pro- 
duced wHh the different amounts of &ght are weighted 
and synthesized into one picture signal proving a wide 
dyrtamic range by means of a s^nal processing system 
including (he video processor 237A. The picture signal 
is then reoomposed into a standard video signal. Even* 
tually. an image is cfisplayed on the image display 
means. 

[0332] According to this embodiment, an Imaging 
means having a filtering means is used in combination 
with an image processing unit. Consequently, an endo- 
sco^nc imaging c^paratus for constructing an image of 
good quality, wNch proves a wide dynamic range, 
despite the simple configuration can be realized. 
[0333] In other words, according to a prior art Ibr con* 
structing a synthetic picture signal proving a wide 
dynamic range, two imaging periods must be mutually 
greatly differentiated. According to this eirbodimeni the 
two imaging periods has the same length. Despite the 
simple signal processing system, the synthetic picture 
signal can be produced to be unsusceptble to noises or 
a motion of an oblect. In other words, a view Image of 
good quality can be displayed according to the synthetic 
picture signal proving a wide dyriamic range. 
[0334] According to this embodiment a synthetic pic* 
ture signal proves a wide dynamic ranga Besides, the 
synthetic picture signal exhibits a characteristic that a 
luBninance l9/el or tone detected therein varies 
smoothly while reflecting a change In brightness of an 
object An image reflecting a deKcate color change of 
the ok^ject can therefore be seen. Consequently, an 
Image helpful in locating an initial-stage lesion or diag- 
nosing the lesion properly can be presented* 

(Tenth Embodiment 

[0335] In the rtlnth embodiment a simultaneous type 
illuminating means and imaging means are employed in 
color imaging under illumination of wtute light. Imaging 
using a field-sequential type itiuminatirtg means and 
imaging means will be described below. 
t033q An endoscopic imaging unit 204B shown in Fig. 
41 Is different from the one shown in Fig. 34 in a point 



described below. Namely, a light source unit 220' shown 
in Fig. 41 Is configured by placing an RGB rotary filter 
234b to be rotated by a motor 234a on an optical path of 
illumination light in the light source unit 220 shown in 
5 Fig. 34. 

[0337] As shown In Rg. 42. the RGB rotary filter 234b 
fias three sector windows bored in a disk. The windows 
are covered with red, green, and blue fUters 200R. 
200Q. and 200B that transmit rays with the wavelengths 

10 of red. green, and blue. The RGB rotary filter 234b is 
rotated by the motor 2348.- INumfriatlon Dght rays of red. 
green, and blue are supplied successively to the light 
guide 21 8. and then propagated by the light guide. Con- 
sequently, the object 223 is Illuminated with the field* 

IS sequential light rays of red. green, and blue. 

[0338] Moreover, a camera head 2 1 6' shown in Fig. 4 1 
employs a monochrome CCD 228. The monochrome 
CCD 226 does not have the mosaic f ilt^ 229 for sepa- 
rating color signal components which is attached to the 

20 imaging surface of the CCD 228 in the camera head 
216 shown In Fig. 34. A f Bter member 235 shown In Hg. 
43 is sitetituted for the fOter member 231. 
{03391 SpecSicaHy. the wheel-shaped fitter member 
235 is attached to the front surface of the CCD 228. Ihe 

2S f ater member 235 is composed of a total of six faters Ra. 
Ga. Ba« Rb, Gbi and 8b. or three pairs of two idnds of fil- 
ters offering different transmittances. The three pairs 
are provided for three colors of red. green, artd blue. 
[0340] Rg. 44 shows a oonflguration of a video proc- 

30 essor 237 adopting the foregoing fietd-sequerrtia] 
method. Processing to be carried out on stages preced* 
Ing a dynamic range eiqpander 244* is nearly identical to 
the processing to be carried out on the stages shown in 
Fig. 38. An output signal of the dynamic range e)9»ander 

9$ 244' is output as red. green, and Uue color signals via 
D/A converting cfrcuits 2S5R, 25SQ, and 255& Conse- 
quently, signals Y/C and VBS are output via an encoder 
256. 

[0341] In this case, as shown in Rg. 43. the red fitter 
40 Ra. green filter Qa. blue f 3ter Ba. red filter Rb, green f il* 
ter Gb. and blue fDter Bb are arranged in tfiat oider. 
Herein, the red filter Ra. green filter Ga. and blue litter 
Ba offer high transmittances. The red filter Rb. green fil- 
ter Gb, and blue fitter Bb offer low transmittances. 
46 [0342] In other words, as shown in Rg. 43, the Ra 
fransmittance is higher than the Rb transmittance, the 
Ga transmittance Is higher than the Gb trsramittance, 
and the Ba fransmittance is tiigher than the Bb transmit* 
lance. 

60 [0343] Rgs. 45A to 45F are explarmtory diagrafm 
ridicat'ng the actions of the imaging means. In frns 
case, field-sequerttiai rays of red. green, and blue are 
fetched sequentially Red. green, and blue judgment 
signals shown in Rgs. 45A. 45B. snd 45C are therefore 

65 employed in imaging. A field-sequential field judgment 
signal shown in Fig. 45D is also employed. 
[0344] AsshowninRg.45E.1hefilterBRa.Ga«andBa 
are placed sequentiaily on the optical path during a first 
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fleU pertod during which the field-sequential field Judg- 
mem signal Is high. The filters Rb. % and Bb are 
placed sequentiany on the optical path during a second 
fieU during which the fteld-sequential field judgment 
signal is low. An exposure value is controlled so that an 
amount of ir^ident light wiD, as shown in Rg. 4SF, be dif- 
ferent between the first and second field periods. 
[0345] For exannple, fbr fetching a red signal, the red 
judgment signal is driven high and the field-sequential 
field judgment signal (hereinafter* field signal) is driven 
high. At this time, the filter Ra is placed In front of the 
CCD 228. When the red judgment signal is driven high 
and the field signal is driven lov^, the filter Rb is placed 
in front of the CCD 228. 

C0346] During the first field period* a larger amount of 
light can be routed to the CCD 228 than during the sec- 
ond field period. 

[0347] Image signals produced during the first and 
second field periods are input to the video processor 
237B serving as an image processing unit G^en image 
processing fbr expanding a dynamic range Is then per- 
formed on the signals. This results irt a red signal prc^r- 
ing a wide dynamic range. Moreover, the ratio of the 
transmittance offered by the fitter Ra to that offered by 
the filter Rb depends on a purpose of use. Any ratio is 
conceivable in the range from, for exan^le. a ratio of 3 
to 1 to a ratio of sev^eral tens to 1 . 
[0348] The same applies to green and blue signals. 
Green arvj blue signals proving wide dynamic ranges 
can be constructed. When the red. 0'een. and blue stg* 
nals are encoded according to a known method, a video 
signal proving a wide dynamic range can be produced. 
[0349] As apparent from Rgs. 45A to 45F, the titter 
member 235 is made one turn during one frame period. 
[0350] Even in this embodiment fhef liter member 235 
is us^ fbr imagtng. In principle, image signals can be 
produced with an exposure value differentiated t>etween 
them without any diange between imaging periods. 
[0351] In this entbodlment the oonfigiiration and 
actions of the dynamic range expander 244* shown in 
Fig. 44 are differem from those of the one shown in Fig. 
38. This is because an input signal of the dynan^c range 
expander 244' is divided into red. green, and triue signal 
components. Rg. 46 shows the configuration of the 
dynamic range expander 244*. 
[0352] A digital video signal input to the dynamic 
range expander 244' contains signal components of 
red. green, and blue signals rendering a first field and 
those rendering a secorKi field. The red. green, and blue 
signals are Input during a period coincident one 
cycle of the field-sequential field judgmatt signal. 
[0353] Assume that the cyde of the field-sequential 
field judgment signal agrees with that of the field judg- 
ment sigr^ shown in Fig. 40B. In tho case, for sepamt- 
ing the red, greea and blue signal components from the 
Input signal of the dynamic rartge e)9>ander 244\ only a 
one-third of a field period is utilized for s^>aratlng each 
signal component 



[b354] A digital video signal input to the dynamic 
range expander 244' is first Input to a signal selector 
imerpoiator 261 in the dynamic range ei^mnder 244'. 
Each odor signal oomponem off the video signal is 
5 decoded and interpolated in order to stretch the cyde of 
each color signal component to a triple. Resultant cdor 
signals are output from the signal selector interpolator 
261. 

[0355] Thereafter, signal processing indicated in Rgs. 

10 39 and 40A to 4QQ is carried out in order to produce 
red. green, and blue digital signals. Fig. 46 shows a 
practical configuration of the dynamic range e)9»nder 
244* fbr canTing out the processing. Rgs. 47A to 471 are 
explanatory diagrams schematically showing inputs and 

T5 outputs of the signal selector interpolator 261 . 

[0356] Refening to Fig. 46, for example, a red signal 
output from the signal selector interpolator 261 is ffiput 
to a red frame memory 247R. The red signal Is also 
input to first and second selectors for red (red first SEL 

20 and red second SEL in Rg. 46) 248Ra and 248Rtx 
Moreover, an output of the red frame memory 247R is 
input to the first and second selectors for red 248Ra and 
248Rb. 

10387] Afield Judgment signal is input to the first and 

S5 second selectors fbr red 248Ra and 248Rb directly and 
via a reversing circuit 249R. Output signals of the first 
and second selectors for red 248Ra and 248Rb are 
input to multipliers 250 Ra and 250Rb. 
[0358] Moreover, an output signal of the first selector 

30 for red 248Ra Is input to first and second LUTs 251 Ra 
and 251 Fttx Output signals of the first and second LUTs 
251 Ra and 251 Rb are multipiied by output signals of the 
first and second selectors for red 248Ra and 248Rb by 
means of the multipliers 250Ra and 250Rb. Resultant 

35 Signals are added up by an adder 252a Consequently, 
a digital red signal is output to a succeeding stage. 
[0389] The same circuit elements as those mentioned 
above are provided for the other color signals of green 
and blue. The alphabet R appended to the reference 

40 numerals denoting the drcuit elements should merely 
be replaced with G or B. The description of the drcuit 
elements bearing the alphabets G and B will k>e omitted. 
[0360] The drcuit elements succeeding the signal 
selector interpolator 261 in the dynamic range eiqaander 

45 244* are realized t3y triplicating the dynamic range 
eoqMnder 244 in Hg. 39 in relation to the color signal 
components. 

[P361] Moreover, the signal selector interpolator 261 
separates color signal components that ^tM be Input 

so sequentially durfang three suthporiods within eadi 
period within which the field-sequential field ludgment 
signal is high or low. The sigrai selector interpolator 261 
then stretches the cydes of the cdor signal components 
into triples, and then outputs resultant signals to the red. 

55 green, and t^ue frame memories through red. green, 
and blue output terminals thereof. 
[0362] The dynamic range tor each color signal is then 
SKpanded as indicated in Rgs. 40A to 40G in the same 



27 



53 



EP0912047A2 



54 



manner as that peiformed by the conllgumtlon shown In 
Fig. 39. (In this case, fbr producing a red color signal, 
the tirame memory input shown in Fig. 40C is regarded 
as an input of tha red frame memory.) 
10363] In this embodiment, as shown in Figs. 45A to 
45C, independent judgment signals are used for red, 
green, and blue signals. However, the emptoymertt of 
the three odor signals alone makes it possible to dis* 
alminate among the red, greea and blue sign^s or 
between f brst and second fields. Rgs. 48A to 48E are 
timing ch£Vts indteating tfie dlscrintination. 
(0364] In this case, two kinds of color judgment sig- 
nals and a field-sequential field judgment signal are 
used tn combination to judge an amount of light incident 
on an imaging device and disaiminate among red. 
green, and fc^e signals, 

[0365] Specifically, referring to Rg. 48A to 48E. when 
f inst and second color judgment signals CI and C2 are 
high and low respectively, a red signal is identified. 
When the first and second color judgment signals CI 
and C2 are low and high respectively, a green signal is 
Identified. When Aie first and second color judgment 
signals 01 and C2 are both high, a blue signal is identi- 
fied. The forst and second color judgment signals are 
used in combination with the f ield-sequerrtlal field judg* 
ment signal, thus providing the same effect as the pmc- 
tical example descrSied in conjunction with Rgs. 45A to 
45R 

[0366] Moreover, the two color judgment signals may 
be substituted for the red. green, and blue judgment sig- 
nals shown in Rg. 46. Newtheless. the signal selector 
interpolator 261 can separate color signal components 
and stretch the cycles of the color signal components. 
The dynamic ranges fbr the odor signals can be 
expanded on a succeeding staga 
(0367] tn this case, a wheel-shaped filter member 
empk^ed wiill be ideritical to the filter member 235 
shown in Rg. 43. Moreover, a second variant of this 
embodiment is concdvabia in the second variant the 
filters are not arranged in the order of the filters Ra. Qa, 
Ba. f^. GbiandBbbutmaybean^ed in the order of 
the filters Ba. Rb. Ga. Gb, Ba, and Bb. A wheel-shaped 
filter member having the ftters thus ananged will be 
described below. 

(0368] Rg. 49 shows a wheel^haped liter member 
235*. 

(0360) Rgs. $0A to 50F are timing charts Indicating 
theactior« of an ima$|ing means having the filter menv 
ber. Since the liter member 235* has titers arranged as 
shown in Rg. 49. unlike the timing charts of Rgs. 45A to 
45F, two color signals of red, green, or blue rendering 
first and second fields are fs^oduced consecutively. IWo 
color signals are produced In the order of red. green, 
arxl blue. Thereafter, a color signal of red rendering the 
first field Is produced. This sequence is repeated. 
[0370] Except the anangement of fitters and the tinvng 
of signals, imaging control is fundamentally identical to 
that indicated tn Rgs. 45A to 45R The delids of imaging 



control will therefbre be omitted. The basic idea is to 
produce an inege rendering a first field with a large 
amount of light incident on the Imaging surface, and an 
^ge r&Klering a second field with a small amount of 
5 incident light An image proving a wide dynamic range is 
thus corotructed. 

[0371] For a better understanding of the second vari- 
ant. Rgs. 50Q to 501 that are timing charts present an 
example of imaging control that exerts the same effect 

10 as imaging control presented by Fig& 45A to 45D. In 
tMs example, the three {udgment signals shown In Rgs. 
48A to 4aC are utilized, and the filter mender 235* 
shown in Rg. 49 is employed. 
[0372] A block diagram showing a basic conf igurab'on 

IS for processing a signal using the filer mennber 235* Is 
nearly identical to that of Rg. 44 or 46. Only a difference 
in signal processing Ges in tfiat images rendering a first 
field and second field are prelected successively on the 
imaging surface in a single color. Rgs. 51 A to 511 are 

2Q timing charts indicating the tinting fbr the image signals. 
(0373) In Rgs. 51 A to 511. Ron (where o stands for 
odd. and n is 0. 1, 2, 3, etc.) denotes a component of 
each of red. green, and blue signals rendering a furst 
field (odd field). Ren (where e stands for even, end n is 

2S 0. 1 , 2. 3. etc.) denotes a contponent thereof rendering 
a second field (even field). 

(0374] In this case, a dynamic range expander has a 
configuration including a signal selector interpolator 
26V shown in Rg. 52 in place of the signal selector 

30 interpolator 261 shown in Rg. 46. 

(0375] A video signal Is input to a decode 263 via a 
buffer 262. An output signal of the decoder 263 is input 
to red. green, and tiue signal stretching circuits 264R. 
2G4Q, and 264B. Based on an externally input control 

38 signal, a decoder stretch control circuit 265 applies a 
control signal for controlling the decoder 263 and red. 
green, and blue stretching circuits. 
(P376] In response to the control signal, the input 
video signal is decoded by the decoder 263. After 

40 decoded, each of red. green, artd blue color signals is 
stretched by interpdatng signal components occurnng 
during a period defined by a field signal. Resultant red. 
green, and blue signals whose cycles have been 
stretched are stared temporaiily in franrte memories 

48 266R. 266Q. and 266B. and output to a succeeding 
Stage successively on a FIFO tsasis. The signal selector 
interpolator 261* Is used to expand dynamic ranges as 
shown in Rg. 46, 

(0377] Specif icaDy. red. green, and blue signal compo- 
80 nents are, as mentianed above, extracted from a di(^ 
video signal tr^ut to the signal selector interpolator 
261*. Thereafter, the red. green, and blue signals have 
the cycles thereof stretched to triples as in<£cated in 
Figs. 51 A to 51 1. Resultant signals are then stored in the 
66 red. green, and blue frame memories 247R, 247Q, and 
247B. 

[0378] The red. green, and blue signals output from 
«ie frame memories are processed to expand dynamic 
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ranges, and then output to en. external monitor or the 
10(8 via a D/A converter. 

[0379] According to this entofiment and fts van'ants, 
an imaging device whose operating speed is low s used 
to expand a dynamic range in substantialty the same 
manner as when a simultaneous type imaging device is 
used. An imaging device whose operating speed is high 
need not be procured. 

{Eleventh Embodiment) 

[0380] Next the eleventh embocfiment of the present 
Invention will be described. This embodiment uses a liq- 
uid crystal device as an exposure value control devica 
The l^uid crystal device of this emt>odiment is not a 
device havong the cap^iiity of a shutter for switching 
transmission and non*transmis8ion by turning on or off 
a control signal. An employed device Is characteristic of 
restricting an amount of light incident on an Imaging 
device by scattering the incident light when the control 
s^nalison. 

[0381] Rg. 53 shows a configuration of a major por- 
tion of an imaging unit A camera head 216B has a Sq- 
uid cryslal devtoe (LCD) 271 interpoeed between the 
lens 227 and CCD 228 shown in Fig. 34. The CCD 271 
is oontroiled by a liquid crystal device drive urnt (LCD 
drive) 272. 

[0382] Afield judgment signal is Input to the 1X0 drive 
unit 272. for exanple, as shown in Fig. 54A, the field 
judgment signal is high during a first fteld period (odd 
field period). At this time, an UCO driving signal is tow as 
shown in Rg. 54B. During a second field period (even 
field period) during which the field judgment signal is 
low, the LCD driving signal is driven high. 
[0383] When the LCD drivirig signal ts driven Ngh, the 
transmfttance of the LCD is lowered as shown in Fq. 
54C, Incidertf Hght is routed to the CCD 228. An image 
is tbnmed with an esqposure value decreased. When the 
LCD driving signal is driven tow, the transmittance is 
raised. Incident light is thus routed to the CCD 228. An 
image is formed wHh the exposure value increased. 
[0384] The LCD drive unit 272 Is incorporated in the 
camera head 2166 in Fig. 53. For compactly designing 
the camera head 216B that is an imag^g unit, the ICO 
drive unit may be incorporated in the Image processing 
unit 207. in either case, the LCD drive unit 272 has the 
abSity to control the actions of the LCD 271 . 
[0385] Based on an input field Judgment signal, the 
LCD drive unit 272 generates an LCD driving signal of a 
proper voltage for driving a liquid crystal in the LCD 271 . 
The signal is applied to the liquid aystal in order to con* 
trol the orientation of liquid crystaliine motecutes, 
wheretjy an amount of Gght transmitted by the LCD 271 
is controlled. 

[0386] More particularly, tor forming an image prone 
to streaky whitening, a low voltage is applied to the LCD 
271 so that the liquid aystalline molecules will be 
aligned in a direction in which incident light propagates. 



For forming an Image prone to blackening, a high volt- 
age is applied to the LCD 271 so that the liquid crystal- 
fine nfK3lecuIe$ wiS be orthogonal to the direction In 
which incident light propagates. 
5 [p387] In this configuration, a signal processing sys- 
tern identical to that of the ninth embodimem can be 
employed. 

p>388] As mentioned above, l>otfi images prone to 
streal^ whitening and blading can be fbrmed. Con* 

10 sequently, an image of good quality proving a wide 
dyriamic range can be constructed by setting an appro* 
priate algorithms in the image processing unit 7. 
[0389] According to tHs einbodimerTt the mechar^- 
caily movable feature employed in the nin^ emtKxii- 

15 ment is unnecessary. Nevertheless, suk>stantially the 
same operations arui advarttages as those of the ninth 
embodiment can be provided. 
[0390] Moreover, a liquid crystal device (LCD) may 
function as an almost perfect shutter according to the on 

20 or off state of an input control signal. 

[0391] Avariantusingan LCD functioning as a shutter 
will be described. In this variant the leyout of the LCD 
271 and others in an imaging unit is identical to that 
shown in Rg. 53. 

25 [Q392] When signals are driven as indicated in the finv 
ing charts of Rgs. S4A to 54C, rto light talis on the CCD 
228 during an even field period. A completely blackened 
image alone is formed 

[0393] During only a proper sidi-period within the even 

so field period, the LCD 271 is During the other 

time, the LCD 271 is mada In this way. for example, 
unlike during an odd field period, an amount of light ind* 
dent on the imaging surface of the CCD 228 Is fimited 
during the even field period. Consequently* tfie same 

35 advantages as those provided bf the bnaging unit, 
which is shouvn in Rg. S3 and whose actions are indi- 
cated in Rgs. 54A to 54C. can be provided. 
(0394] Rgs. 55A to 55C are timing charts in accord- 
ance with the variant. In this variant, an amount of light 

<o falling on the CCD 228 during an even f ieki period is set 
to a half of an amount of light falGng thereon during an 
odd field period. A non-transmission period (during 
which the shutter is closed) is a half ta of the even field 
period lb. Alternatively, the norv-transmisslon period 

45 maybe set aitstrarily according to the state of an object 
to be imaged or a purpose of use. for example, the non- 
transmission period may be set to a several subnrwltlple 
of the even field period or a several hurKfreds submulfi* 
pie thereof. 

60 (0395] Even in this variant the CCD drivir^ signal fbr 
driving the CCD 228 is driven once during each field 
period, that is, twice during one fwno period as it is in 
the first, embodiment 

[0396] T)^ variant provides ^most the same advsm- 
55 tages as the tenth ernbodlment. For example, the sub- 
period wHhin the even field period during which the LCD 
driving ^gnal is driven high may be variable. In this 
case, the CCD driving signal may not be varied. Never- 
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theless, images can be formed by aititraiily changing 
the ratio of an oqiosure value for one Image to that for 
another innge. 

(0397] For example, a brightness level ol an ot^ect is 
detected, H the brightness level is high, the 8ut>-period 
within the even f idd period during which the IXD driving 
signal is driven high is shortened in order to form an 
Image with an exposure value decreased. 
{0398] The image formed with the decreased expo- 
sure value and another image are synthesized with 
each other. A resultant image is processed to expand a 
dynamic range. Tt)U8» even when an otqect SKhfoits a 
^h brightness level, a view fnwge whose high-lumi- 
nance level portion win not have a eaturafion value can 
be constructed. 

(TweHth Embodiment) 

[0399] Next, an endoscopic Imaging apparatus of the 
twelfth emidodiment of the present invention wiR be 
described. 

(0400] As presented in the ninth to el«nrenth embodi* 
ments, for oor^tructing an image that proves a wide 
dynamic range, an amount of light incident on the imag- 
ing device 208 is controlled. Thus, an image prone to 
streal^ wftitening and an image prone to blackening are 
tbrmed to render two fields. 

[0401] In general, when extraneous natural Gght is 
Insufficient if an imaging apparatus is used in combina- 
tion with, for example, an endoscope, a light source unit 
must be prepared additionaily in order to ensure a nec- 
essary amount of light. In this case, an amount of light 
reflected from an ot^ecX of observation is linked by an 
amount of light emanating from the fight source unit If 
the amount of light emanating from the ligid source unit 
can be controfted, an exposure value (an amount of inci- 
dent tight) may be controlled aooording to a technique 
different from the one adopted in the ninth errbodment 
to thirteenth embodimem. By properly controlling tim- 
ing, an Imi^ prone to elreal^ whitening and an Image 
prone to blad<ening can be tonmed. This embodiment 
adopts this idea. 

(0402) The ninth embodiment to eleventh embodiment 
can be adapted to an imaging apparatus not indutfeig a 
light source unit In other words, the ninth to eleventh 
embodiments can be adapted to an imaging apparatus 
that not always requires a light source unit, such as, a 
video camera. 

[0403] Figs. 56 schematicaDy shows a configuration of 
an endoscopic imaging apparatus 274 of the twelfth 
embodiment The endoscopic imat^ng apparatus 274 
has an Imaging unit 204* not including the exposure 
value control means 205 that is included in the imaging 
unit 204 shown in Fig. 33. Instead, an amount-of-emit- 
ted light control means 277 is included In a light source 
urtit 276 having a ligtit emitting means 275 incorporated 
therein. An amount of emitted light propagated over the 
optical path 203 t>y way of a light guide 278 in order to 



Bluminata the object of observation 202 is then control- 
led. 

[0404] Moreover, an image processing unit 207* has a 
Gght adjusting circuit 279 interposed between ^e image 

5 processing circuit 21 0 and signal generator 206 that are 
included in the image procesdng unit 207 shewn in Rg. 
33. A signal sent from the image processing circuit 210. 
which processes an image signal output from the Imag- 
ing device 206, is input to the light adjusting circuit 279. 

10 A control signal is then produced to control the light 
en^ng means 275. Moreover, according to this 
ennbodiment a field judgment signal generated t)y the 
signal generator 208 is Input to the amount-of-ernitted 
Gght control means 277. 

15 [0405] Rg. 57A shows a configuration of the light 
source unit 276. A lamp 281 is connected to a power 
supply 282 and Gght emission control circuit 283. The 
lamp 281 is thus controlled to emit a given emount of 
Gght A disk-like filter memt>er 284 is located on an opti- 

20 cal path of illumirmtion Gght in front of the lamp 281 . The 
f Dter merrier 284 has an axial member attached to the 
center thereof. The axial member is coMpled to an axis 
of rotation of a motor 286 that rotates wl^ a motor driv- 
ing signal sent from a motor drive control circuit 285. 

2S The filter member 284 is therefore driven to rotate 
together with the motor 286. 

[0406] The motor drive control circuit 285 is powered 
bf the power supply 282. Afield judgmertt signal is sent 
from the ^ge processing unit 207*. and then input to 

30 the motor drive control circuit 285. The motor drive con- 
trol circut 285 drives the motor 286 to rotation synchro- 
nously with the signal. Moreov^, the power supply 282 
is plugged into the mains or an external power source. 
Moreover, a control signal sent from the light adjusting 

33 drcuft 279 in the image processing unit 207' is input to 
^e light emission control circuit 283. 
[D4071 The filter member 284 is. as shown in Rg.57B, 
composed of filters Fns and R) offering different transmit- 
tancas. For exarnpla, the transniittance of the filter Fb is 

40 set to a one-tHndl.of the transmrttanca of the filter Fa. 
[0408] The other components are nearly identical to 
tf\ose of the ninth embodiment. 
(0409] In this embodiment, the nrotor 286 Is rotated 
synchronously with a field judgment signal shown in Rg. 

45 58A. The fitters Fa and Fb are. as shewn in Rg. 58B. 
alternately inserted into the optical path of IGunninatfon 
Gght in front of the lamp 281 during respective field peri- 
ods. 

[0410] When the filter Fa Is placed on the optical path. 

50 an amount of Gght emitted from the tamp 261 inthelight 
source unit 276 increases as shown In Fig. S6C (the 
amount of emitted light Is large). When the filter Fb is 
placed on the optical path, the amount of light emitted 
from the lamp 281 in the light source unit 276 decreases 

65 (the amount of emitted light Is smaD). 

[0411] The amount of emitted light is thus set to be dif- 
ferent between two field perloda The object of observa- 
tion 202 is therefore IDumlnated with an amount of light 
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that (s different between the two field periods An 
emoiffit of fl(|ht reflecting from the object of obeervetion 
202 and falling on the imaging device 206 becomes dif- 
ferent between the two field p&iods. 
[0412] According to this embodiment, an amount of 5 
iinimination fight is controlled in order to control an 
amount of light inddent on the imaging device 206. 
[0413] Moreover, acoonllng to this embodiment the 
light adjusting circuit 279 integrates conponents of a 
lumoianee signal which are sent from the Image fo 
processing unit, 210 during, fbr example, one fiame 
period, and thus detects an average luminance level. 
The average luminance level Is compared with a stand- 
ard luminance level. An error signal indicating an error 
from the ^andaid luminance fevei is output as a control is 
signal, which is used to adjust light to the Dght emission 
control circuit 283: The light emissior^ control circuit 283 
then controls, fbr example, an amount of light emitted 
from the lamp 281. 

(0414] For example, the average luminance level cal- 
culaled by Integrating the components of the luminance 
signal sent during one frame period may be lower than 
the standard luminance level. In this case, a control sig< 
nai praportional to an error from the standard luminance 
level is input to the light emisston control circuit 63. Con- ss 
trol is thus given in order to increase a glow cunent to 
be supplied from the Gght emission control circuit 283 to 
the lamp 281 . 

[0415] Owing to the control, the average luminance 
level is approached to the standard value. Cense- 3o 
quently. a view image suitable for Observation can be 
constructed. 

[0416] Moreover, the light adjusting circuit 279 con- 
trols an AGC drcutt In the Image processing circuit 210 
In terms of gain control. For exampta the AGC drcutt ss 
miQf be allowed to control a gain in order to attain a lumi- 
nance 1ml suitable fbr observation translenlly (quicMy)- 
Thereafter, control Is given to emit tight slowly in order to 
attain an anrtount of Qght suitable for obsevation. 
Accordingly, the AQC drcuit returns a gafri to a steady- 40 
state value. 

{041 7] Fig. 59 shows a configuration of a Hght source 
unit 276' of a variant. The light source uitit 276* has a liq- 
uid crystal device (LCD) 288 stationed in front of ^e 
lamp 281 shown fn Rg. 57A. The LCD 288 Is controlled 45 
by a LCD drive unit 289. The other components are 
Identical to those shown In Rg. 57A. 
{04iq The LCD 288 is driven according to the timing 
indicated in Rgs. 54A to 540 or Rgs. 5SA to 55C. 
[0419] Moreover, the operations and advantages of so 
this variant are almost the same as those of thetweHlh 
emtsodbnent. 

(Thirteenth Emboctimenf) 

6S 

[0420] Next the thirteenth entafiment of the present 
invention will be descrSsed. 

[0421] In tfie NveHth embodiment the amount-of*emit« 



ted Hght control means 277 is located fn front of the fight 
emitting means in the light source unit 276. As another 
method of controlling an amount of emitted light a 
method of controlJIng an amount of emitted light k)y con- 
trolltng an amount of light emanating from the Gght emit- 
ting means Is conceivable. 

[0422] In this method, an amount of lig^t emanating 
from a light emitter Is oontroBed accordoig to arttltrary 
timing. For forming an image prone to streaky whiten- 
ing, tfie light emitter is allowed to glow fully. For forming 
an image prone to blacfcening. the fight emitter is con- 
trolled to glow minimally. The timing of switching 
amounts of endtted light is synchronized with the timing 
of switching fields that constitute a display image. Con- 
sequentiy, an image prone to streaky whitening and an 
image pmne to tilackening can l>e formed to render the 
fields. When an algorithm set in the image processing 
unit is optimized an onage proving a wide dynanrtic 
range can tie provided, 

[0423] Moreov9. a motion picture is not always 
required for image observation. For example, when 
photography is carried out a stiO image may tie needed. 
In the case of the still image, an image proving a wide 
dynamic range is often not necessary. A region to l>e 
photographed should merely be illuminated to attain a 
brightness level suitable for photography. Even if the 
other region t>ecomes hard to see. no problem occurs. 
On such an occasion, an image not proving a wide 
dynamic range will da Another mode is th^efore set so 
that an onage can be displayed in the mode (within 
ongoing normal screen levels) instead of a wide 
dynamic range mode. When the modes can thus be 
switched* wf^hever of a motion picture and still image 
that is suitable for obsenratfon can be presented to a 
viflwer. 

10424] According to this embodiment the fight emit* 
ting means 275 in the light source unit 276 In the twelfth 
embodiment is caused to emit pulsed light An amount 
of light Is thus varied depending on a field. Imaging Is 
carried out in this state. Rg. 60 shows a configuration of 
an endoscopic imaging apparatus 290 of the thnrteenth 
embocBmer^. 

[0425] A camera head 293 servir^g as an imaging unit 
la ntounted on an optical endoscope 292 indud^g an 
observation optical system 291. An output signal of the 
imaging device 206 In the camera head 293 Is irput to 
an image processing unit 207". The image processing 
unit 207' has a light adjustment and r^^t errtission sig- 
nal correcting drcuit 279^ that sidsstitutes for the light 
aiQusting drcuit 279 in the image processing unit 207 
shown in Rg. 56. 

[0426] The 1^ adjustment and light emission signal 
correcting drcuit 279* has not only the capat»lity of the 
Hght ati[justing drcuit 279 but also the ability to correct a 
glow signal as merrtioned later. 
P>427) A light guide 294 in the optical endoscope 292 
is coined to a light source wiit 295 way of a light 
gukle cable 278. A lamp 296 senm as a light emitting 
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means and is included in the light source unit 295. The 
lamp 296 is driven to glow a light eniisslon drive unit 
297. The light emission drive unH 297 is controlled by a 
light emission control circuit 298. 
(0429] The light emisston control orcuit 298 uses the 
light emission drive unit 297 to control light emission of 
the lamp 296 according to a field judgment signal sent 
from the signal generator 208 arvi a light emission tlnv 
ing control signal. The other components are identical to 
those shown in Fig. 22. The description of the oompo- 
nents will be omrtted. 

C042q Head, the actions of this embodiment will be 
described with reference to the timing charts of Figs. 
61 A to 61 D. The lan^ serving as a light emitting means 
in this embodiment glows to emit one kind of pulsed 

light. 

[0430] A practical example of this embodiment win be 
described on the assumption that the frequency of 
causing the lamp 296 to glow during a field period is var- 
ied. 

[0431] The signal generator 208 in the image process* 
Ipq unit 207 produces a pulsating tight enussion timing 
control signal shown in Fig. 61 B according to a field 
judgment signal shown in Fig. 61 A. The ligtrt emission 
timing control signal generated txf the signal generator 
208 is output to the tight emission control circuit 298 in 
the light source unit 295. 

[0432] The light emission control circuit 298 in the light 
source unit 295 outputs a light enrtitter control signal. 
The light emitter control signal causes the lamp, which 
is a tight source, to glow Instantaneously at the leading 
edge of the light emission timing oontrol signal. With the 
light emitter control signal, the lamp 296 is driven to 
glow by means of the Oght emission drive unit 297. 
[0433] In the practical example shown in Fig. 61 C. 
three pulses of the light emission timing control signal 
are generated during a first field period (odd field 
period). One pulse thereof is generated during a second 
field period. 

[0434] When the glow diaracterisSc of the lamp 296 
is utilized, an amoum of emitted light varies as shown in 
F^. 61 C. When the amount of emined lifi^ varying from 
field to field Is averaged* it varies as shown in Fig. 61 D. 
An amount of illumination light to be Irradiated to the 
object of observation 202 dtfTers in average amount of 
light from field to field. In this state, an object image is 
formed t»y the Imaging device during each field period. 
Consequently, an image prone to streaky whitening is 
formed during afirst field period and an Image prone to 
blacking is (brmed during a second field period. 
(043S1 Two thus formed images are synthesized with 
. each other by the dynantic range ^eponder 244 shown 
in Rg. 7. This results in an image proving a wide 
dynamic range. Depending on the characteristic of a 
lamp, there may be a time tag after a signal prompting 
the lamp to glow is output from the light emission control 
drcuh until the lamp comes to glow fully. In IMs case, a 
proper amount of Bght will not be Irradiated to an object 



of observation during tfie time biterval until &ie lamp 
comes to glow fully. 

[0436] In the practical example, a proper amount of 
fight cannot be irratfiated to an otqect of otKervatfon for 

5 some time after horizontal scanning for rendering a first 
field is started. During the time intenml« an upper por- 
tion of a cfisplay area on a typical TV monitor beyond an 
upper quarter of the display area thereon is scanned to 
draw 31 to 71 horizontal scanning lines. However, a 

fo proper amount of light cannot be irradiated to an object 
of. observation during the time interval. An image prov- 
ing a wide dynamic range cannot therefbre be displayed 
in the portion of the displfly are on the typical TV moni- 
tor. 

15 (0437) f=br coping with the foregoing drawback, a field 
judgment sis^ and image signal are input to tfie light 
acSustment and light em'sdon signal correcting circuit 
279* in the image processing unit 207*. For each hori- 
zontal scanning tine, a luminance level \s compared with 

20 a luminance level incBcated by a signal component ren- 
dering the previous horizontal scanning line. If there Is a 
marked difference between the luminance levels, a light 
emission timing oontrol signal that will slightly lead the 
field judgmem signal is generated in order to absort) the 

ss foregoing time lag. Namely, the time lag occurs due to 
the characteristic of a lamp when the lamp is driven. 
10438] Moreover, when tfie amount-of-emitted light 
control means in the tight source unit 295 is merely 
driven according to a field judgmem signal, a proper 

JO amount of light may not be irradiated entirely to an 
object of observation. Depending on the characteristic 
of a light emitting means, it may take too much time until 
the light enitting means, for example, a lamp comes to 
glow fully alter it is driven. On such an occasion, a suffi- 

35 dent amount of light required for observation may not 
t}e preserved. 

[0439] An mount of Dglil enritted by the lic^ source 
unit 295 must be sufficient and proper for observation. 
For this purpose, a glow signal oonrecting clrcut is Incor- 

40 porated in the image processirrg unit 107*. The glow 
signal con^ect'ng circuit conects a control signal, which 
is output from the image procesdng unit 207** to the Hght 
source unit 295, according to image information output 
from the Imaging device 206. Imaging can thus be per- 

4S . formed by the imaging device 206 so that the timing of 
the imaging will always be matched with an amount of 
Hght emitted from the light source unit 295. 
[0440] A method of pmdudng a picture signal to be 
output to a TV monitor or the like is identical to that 

so erfplpyed in the ninth ennbodiment* 

I0M1] Moreover. acoorcBng to this embodiment, a 
freeze switch that is not shown may be induded. The 
freeze switch is used to send a write disabling signal to 
a frame memory in the color separation and white bal- 

ss ance and A3C drcuit 245 shown in, for example. Fig. 
38. An image whose data has been written immediately 
previously is output repeatedly. The image Is then dis- 
played on an image display means such as a TV moni- 
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tor. 

[0442] Moreover, this embocfiment has been 
described that the light emission control dfcutt 298 
allows the lanp to glow in response to a tight emission 
timing control signal generated by the signal generator s 
208. Alternatively; the number of pulsed light rays to be 
emitted may be able to be set manually in this case, the 
number of pulsed light rays to be emitted should be able 
to be set tor each of two field periods. In a special exam- 
pie or mode, the nurrbers of pulsed light rays to be emit- io 
ted during the two field periods may be set to the same 
vatua tn other words, the amounts of light to be emitted 
during the two field periods may be set to the same 
value. A dynamic range is not expanded in this mode. 
[0443] For example, a DIP switch composed of a plu- is 
rality of switching elements may be used to input a plu- 
rality of digital signals as a pulsed light instruction signal 
to the signal generator 208. The signal generator 208 
then outputs a light emission tning control signal to ttie 
light emission control drcuit 298 according to the timing 20 
defined by the number of pulses of the pulsed light 
instruction signal. 

[0444] For example, when a noteworthy portion of an 
object to be obeen/ed in a still image must be set to a 
brightness value permitting easy otiservation. it can k>e ss 
observed in a wide dynamic range mode. However, if a 
change in brightness level of the portion is suppressed 
in the wide dynamic range ntode. a viewer may manu- 
ally set an amount of emitted lig^t suitable for obs&va- 
tlon. A proper view image may thus be constructed. 30 
[0445] Moreover, the method of manually instructing 
the number of pulsed tight rays to be emitted may not i>e 
adopted. Instead, an instruction signal instructing 
Increase or decrease of a current number of pulsed light 
rays may k>e manually Input to the signal generator 208. ss 
A lig^ emission timing control signal may then be out- 
put to the Kght emission control dradt 298 acoorcfing to 
the instructicn signal. 

[0446] According to this &Tt»xllment the same 
advaittages as those of the twelfth embodiment can be 40 
provided. Moreover, whether a motion picture or still 
image is requested, an image formed with a proper 
exposure value can be provided to a viewer. 
[0447] Accorcfing to the imaging method employed in 
this embodiment, sinilarty to that employed in the tenth 4S 
entfsodiment, a wheel-shaped (dtsk-iike) color filter may 
be attached to the f^ont sutlaoa of the imaging devlca 
[D448] An eiposura value Is controlled according to a 
technique of discifminating among the transntittances of 
filters of three primary colors constituting the wheel* so 
shaped color filter. Otherwise, a technique of differenti* 
ating the transntittance of one filter from the transmit- 
tances of the other two filters may be adopted for 
controlling an esqposure value. Thus, an image proving a 
wide dynamic range can be provided. 55 
[0449] Moreover, the number of color filters constitut- 
ing a f 9ter is three. Alternatively, two lands of color filters 
offering different transmittances m^ be provided for 



each color of three primary colors. Red, green, and blue 
color filters offering Ngh transrrtittances. and red, green, 
and blue color filters offering low transmittances may 
tiien be arranged equldlstantly on a wheel-shaped 
member. An image prone to streaky whitening and an 
image prone to bladdng are formed for each of the tttree 
primary colors by the imaging devtee. Thereafter, the 
aforesaid procedure is followed and an image proving a 
wide dynamic range is constructed. 
PMSO] Owing to the aforesaid configuration, an image 
proving a wide dynair^ range can be provided for a 
user. This means that an bnage helpful in observing an 
olject can be displayed over a whole screen. Eventu- 
ally, treatment or the like can be carried out appropri- 
ately 

[0451] Moreover, imaging modes may be changed 
according to an image to be displayed on an image dis- 
play. Thus, an image helpful in observing an object may 
be provided for a viewer. 

[0462] As described above, according to the ninth to 
thirteenth embodiments, there is provided an endo- 
scopic imaging apparatus consisting of: an imaging unit 
haM'ng an imaging device, wtvch receives light reflected 
f^om an object of conservation and forms an image of the 
oiject of observation during first and second imaging 
p^ods, incorporated in an endoscope; an Image 
processing unit for processing signals representing first 
and second images formed during the first and second 
imaging periods, and constructing one synthetic image 
proving an expanded dynamic range by synthesizing 
ttie first and second images; and a display means for 
diGplaying the synthetic image. 
10453] An amount-of-inddent light control means Is 
induded fbr controlling an amount of light Inddent on 
the imaging device during at least one of the fnrst and 
second imaging periods. The amount of incident light is 
controlled so that it will be different from one imaging 
period to the other. The imaging periods need therefore 
not be sM to rrajtualiy greatly different lengths. Merely 
by controlling tfie amount of Gght oiddent on the imag- 
ing device, a view image proving a wide dynamic range 
can be constructed using images formed with different 
amounts of light Moreover, the view image is unsuscep- 
tible to noises, and enjoys good image quality. 
[0454] Inddentally, tfie aforesaid embodiments m9f 
be partly combined to construct enrtoodiments ttiat also 
belong to the present invention. 

Claims 

1. An imaging apparatus, comprising: 

an imaging means for successively outputting a 
first inuige signal produced by imaging an 
object during a first esqsosure time and a sec- 
ond image signal produced t>y imaging said 
object during a time shorter than saki first 
e39K)6ure time; 
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an Image signal producing means oorr^posed 
ot first and second weighting drciAs for apply- 
ing a fust weight which decreases monoto- 
nously with an increase In light levd up U> a 
Oght level causing said first and second image $ 
signals to have a saturation value, and a sec- 
ond weight which increases monotonously 
therewith, to said first and second image sig- 
nals under the condition that the sum of said 
fnst and second weights is 1 ; and an adding dr- lo 
cuit for adding up first and second picture sig* 
nals produced kiy applying said first and 
second weights to said first and second Image 
signals by means of said ffrst and second 
weighting circuits; and ts 
a signal processing means tor processing a 
picture signal output from said addmg circuit 
and producing a video signal acoorcfing to 
which an image can be displayed on a display 
means. so 

2. An Paging apparatus according to claim 1, further 
conprising an eifwsure time setting means for var- 
ying at least one of said first and second oqposure 
t'mes. 25 

X An imaging apparatus according to daim 2. 
wherein said exposure time setting means uses a 
%vavefomvdetected signal produced by detecting 
the waveform of said first or second ima^ie signal, so 

4« An imaging apparatuSi comprising: 



5. An Imaging apparatus according to claim 4, 
wherein said imaging means images an object dur- 
ing a second ei^sosure time thai is shorter than said 
first exposutQ time, and thus outputs said second 
image signal that has the saturation value relative 
to a higher light level than said first Image signal. 

6. An Imaging apparatus according to claim 4, 
wheran during a second exposure time during 
which said second image signal is produced, an 
amount of light coming from said object and falfing 
on eaid imaging means through an imaging window 
is restricted by an amount-^mght restricting 
means, and said imagkig means outputs said sec- 
ond image signal that has the saturation value rela- 
tive to a higher level than said first image 
signet 

7. An Imaging apparatus according to claim 4, 
wtterein said weights applied t)y said pictiffe signal 
produdng means are such that when a light level Is 
much lower than the light level cau»ng said first 
image signal to have the saturation value, said first 
weight to larger than said second weight: and when 
the level Is higher than the light level causing 
said first image signal to have the saturation vaJue. 
said second weight is larger than said first weight. 

8. An imaging apparatus according to claim 4, 
wherein said first weight function Fl(x] is cos ^(px) 
where x is a light level and p is a ooeffident and 
said second weight function F2(x) is 8in^(px) . 



an imaging means for successively outputdng a 
first image signal produced by imaging an S5 
object during a first wpoisure time, and a sec- 
ond image signal that has a saturation value 
relative to a higher Oght level than said first 
image signal; 

a picture signal produdng means composed of: 40 
fast and second weighting circuits for applying 
a first weight, which decreases monotonously 
an Increase in light level up to a fight level 
causing said first and second Image slgr^als to 
have a saturation value, artd a second weight 46 
which increases monotonously therewith, to 
8^ first and second image signals under the 
condition that the sum of said first and second 
weights ie 1 ; and an adding drcult for adding up 
first and second picture signals produced by so 
applyvig said first and second weights to said 
first and second Image signals means of 
said first and second weighting droats; and 
a signal processing means for processing a 
picture signal output from said adding drcuK ss 
and produdng a video signal according to 
which an image can be displayed on a display 
means. 



9. An imaging apparatus according to claim 8, 
wherein said coefficient p satisfies p<:9ff/(2s) where 
s is a fight 1^ of light incident on said ima^ng 
means. 

ia An Imaging apparatus according to claim 4, 
wherein said imaging means btdudes a progres- 
sive imaging device tiaving two systems of horizon- 
tal transfer output drcuits. 

11. An imaging apparatus according to daim 10. 
wherein said signal processing means produces a 
video signal confomiable to the interladng. 

12. An imaging apparatus according to claim 4. 
wherein said image signal producing means 
indudes a weight data storage means that stores 
data of said first weight to be applied to said first 
image signal and data of said second weight to be 
applied to said second image signal. 

13. An inraging apparatus according to daim 12, 
wherdn said weight data storage means stores 
data of a weight to be applied to said first image sig- 
nal and data of a weight to be applied to said sec- 
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ond imacie signal, and the weights exMbit different 
GharBcteri6tic& 

14. An imaging apparatus acooiding to daim 13, fur- 
ther comprising a brightness detecting means for 
detectirtg brightness information of an object in an 
output signal of said imaging means, wherein a 
weight to be applied to said first image signal and a 
weight to be applied to said second Image signal 
are selected based on the brightness information of 
an object and thus read fronn said weight data stor- 
age means. 

15. An imaging apparatus according to daim 5* 
wherein said ima^ng means Images said object 
during said first exposure time, and produces said 
first image signal and second image signal. 

16. An imaging apparatus according to daim 4. 
wherein said picture signal produdng means pro- 
duces a synthetic picture signal exhibiting such a 
charaderistic that a (fifferential coefficient thereof 
relative to a light level varies continuously with an 
increase in light level ip to a Gght level causing said 
second image signal to have the saturation value. 

17. An imaging apparatus accoiding to daim 16. 
wherein the differential coeffident decreases 
ntohotonousJy relative to the light level. 

18. An endoscopic imaging apparatus, oonrprising: 

an endoscope fiaving an elongated insertion 
unit irradiating tliumfaiation light to an objed 
through an illumination window located at the 
distal end of said insertion unit and induding 
an imaging means for successively outputting a 
first image signed produced by imaging $£ud 
object Qluminated with said Illumination li^t 
during a first exposure time, and a second 
image signal that has a saturation value rela- 
tive to a higher light level than said first image 
signal; 

an image signal produdng means contposed 
of: ftrst and second weighting dn^^its for apply- 
ing a first weight which decreases monoto- 
noudy wKh an increase in Kght lo^el up to a 
light level causing said first and second image 
signals to have the saturation value, and a sec- 
ond weight which increases monotonously 
therewith, to said first and second image sig- 
nals under ^e condition that the sum of said 
first and second weights is 1 ; and an adding or- 
cuit for adding up first and second picture sig- 
nals produced by apptyirrg said first and 
second wights to s^ first and second image 
signals by means of said first and second 
wdghting drcuits; 



a dgnal processing means tor processing a 
pidure dgnal output from said adding circuit 
and produdng a video signal according to 
wHoh an innage can be displayed on a display 
5 means; and 

a display means for displaying a synthetic 
image represented fay said pidure signal when 
inputting said video signal. 

10 19. An endoscopic Imaging apparatus according to 
daim 18. wherein said Imaging means images said 
object during a second ocposure time that is 
shorter than said first exposure time, arKi thus out- 
puts said second image signal that has the satura* 

15 tion level relative to a higher light value than saKi 
first image signal. 

20. An endoscopic imaging apparatus according to 
daim 18, wherein during a second exposure time 

so during which said second image signal is produced, 
an anrtount of light coming from said object and fiaO- 
ing on said imaging means through an imaging win- 
dow is restricted by an amount-of-light restricting 
means, and said Inaging means outputs said sec- 

25 ond image signal that has the saturation value rda- 
tive to a higher tight level than said first ims^e 
signal. 

21. An endoscopic imaging apparatus according to 
30 daim 18, further comprising a light source unit for 

supplying illumination light to a light guide that runs 
tfifough said insertion unit of said endoscope, prop- 
agates iOuminafion tight, and emits the illumination 
light through said illuminatton window. 

35 

ZSL An ervlosoofric Imaging apparatus aoooiding to 
daim 21. wherein during a second exposure time 
' during wMdi said imaging means produces said 
second image signal, said light source unit allows 
40 an amount-of*Gght restricting means to restrict iBu- 
minatton light to be supplied to said light guide, and 
said Imaging means outputs said second image 
signal ttiat has the saturation value relative to a 
higher light level than said first image signal, 

45 

23. An endoscopic imaging apparatus aocoiding to 
daim 22, wherein said amoivit-of-Ught restricting 
means is a light restriction filter for restricting iltunti- 
nation light geneiBted k>y a lamp and supplying 

so resultant tight to said light guide. 

24. An endosoofto Imaging apparatus according to 
daim 22. wherein said amouit-of-light restricting 
means restricts an amount of illumirwtion light gen- 

ss eratedbyalamp. 

25. An endoscopic imaging apparatus according to 
daim 18, wherein said endoscope is an electronic 
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endoscope having an imaging device, which is 
indided in said imaging means and prcvUed with 
the aMity to photoelectricalty convert a signat« 
placed on the image plane of an Objective optical 
system located at 9ie distal end of said elongated s 
insertion unit. 

26. An endoscopic imaging apparatus acoortfing to 
claim 18, wherein said endoscope is a TV camera- 
mounted erxtoscope conposed of an optical endo- w 
scope having an image prq;»gating means for 
propagating an object image fonmed an objective 
opticat system located at the <Sstal end of said eton- 
gated insertion unit to an opticat system, and a TV 
camera that is mounted on an eyepiece of said opti* ts 
cal endoscope and has an imaging device, which is 
included in said imaging means and provided with 

the abtlHy to photoelectrically convert a signal, 
Incorporated therein. 

20 

27. An endoscopic imaging apparatus according to 
claim 16. wherein said endoscope includes a com- 
mon image formation optical system, and said 
imaging means Is conposed of a plurality of imag- 
ing devices located at positions respectively at 2S 
which a plurality of bnages are formed through a 
plura&ty of apertures k>y said image formation opti- 
cal system. 

28. An endoscopic imaging apparatus according to so 
claim 19, wherein said Imaging means inuiges said 
otq'ect during said first exposure time so as to pro- 
duce said first image signal and second Image sig- 
nal. 

3S 

29. An endosoopic imaging apparatus according to 
daim 16, wherein said Imaging device included In 
said imaging means has a color separation fater 
used to achieve color Imaging under whHa illumina- 
tion Gght. 40 

60. An endosoopic imaging apparatus accoitling to 
claim 18, wherein said imaging means is a fieldo 
sequential imaging means that includes a mono- 
chrome Imaging device not having a color separa- 48 
tion filter, and that carries out color imaging under 
illumination of field-sequential light having a plural- 
ity of wavelengths. 

31 . An imaging apparatus, comprising: so 

an Imaging means for successively outputtir^ a 
fust image signal produced by imaging an 
ct^ect during a first exposure time, and a sec- 
ond Image signal that is produced by imaging 6S 
said object during a second exposure time 
shorter than said forst e)qposure time and that 
has a saturation value relativa to a higher Oght 



level than said first Image signal; 
a picture signal producing means composed of : 
first and second weighting drcuHs fbr applying 
a first weight which decreases monotoncMiSly 
with an inaease in light level up to a light level 
causing said first and second inage signals to 
have the saturation value, and a second 
weight which Inaeases monotonously there- 
with, to said first and second image signals 
under the condition that the sum of said first 
and second weights Is about 1: and an adding 
circuit tor adding up first and second picture 
signals produced by applying said first and sec* 
ond weights to said first and second image sig- 
nals by means of said first and second 
weighting circuits; and 

a signal processing means for processirtg a 
picture signal output from siud adding drcuit 
and producing a video signal according to 
which an image can be displayed on a display 
means. 

32. An imaging apparatus, comprising: 

an imaging means for successively outputting a 
first image signal produced by imaging an 
ot^ect during a first exposure time, and a sec- 
ond image signal that has a saturation value 
relative to a higher light level than said first 
image signal; 

a picture signal produdng means composed of: 
first and second weighting drcuits tor applying 
a first weight which decreases monotonously 
with an increase in light level up to a Oght level 
causing said first and second image signals to 
fiave the saturation value, and a second 
weight whidi Increases monotonously there* 
with, to said first and second image »gnals 
under the condition that the sum of said first 
and second weights is about 1; arul an adding 
drcuit for elding up first and second picture 
signals produced by applying said first and sec- 
ond weights to said first and second image sig- 
nals by means of said first and second 
weighting drcuits; and 

a signal processing means for processing a 
picture signal output from said adding circuit 
and. producing a video signal according to 
which an image can be displeyed on a di&play 
means. 

33. An imaging apparatus, conprislng: 

an imaging means for successively outputting a 
first image dgnal produced by imaging an 
object during a first exposure time, and a sec- 
ond Image signal that has a saturation value 
relative to a higher light level than said first 
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tmage signal: 

a picture signal producing means conposed of : 
flrsl and second weighting circuits tor applying 
a first weight, wtvch deaeases monotonousty 
with an increase in light level up to a light level s 
catling said first and second image signals to 
have the saturation value, and a second 
weight wttlch Increases monotonously there- 
with, to said first and second image signals in 
relation to any of light levels ranging to the light 10 
level, which causes at least said first image sig- 
nal to have the saturation value, under the con- 
dition that the sum of said first and second 
weights remains constant; and an adcfing cir- 
cuit for adding up picture signals produced by is 
applying said first cmd second weights to said 
first and second image s^nals by means of 
said first and second waghting circuits: and 
a signal processing nteans fbr processing a 
picture signal output firom said adding circuit 20 
and producing a video signal aocofding to 
which an Image can be dieplayad on a display 
means. 

34, An imaging apparatus according to daim 33. as 
wherein when a 6ght level is high^ than the tight 
level causing said first image signal to have the sat- 
uration value, said first weighting drcuil outputs a 
weight coefficient of 0. 

30 

35. An imagirtg apparatus acconling to claim 33. 
wherein when a light level is higher than the light 
level causing said first image signal to have the sat- 
umtf on value, said picture signal Is determined sub- 
stantially with a weight coefficient that is applied to 35 
said second image signal by said second weighting 
circutt 
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